Selective mono/stereo visual displays

ABSTRACT

To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.16/825,907, filed Mar. 20, 2020, which is a continuation of U.S. patentapplication Ser. No. 16/109,624, filed Aug. 22, 2018, which is acontinuation of U.S. patent application Ser. No. 14/952,007, filed Nov.25, 2015.

FIELD OF THE INVENTION

This disclosure relates to displaying graphical content in one or bothof mono and stereo formats. More particularly, the disclosure relates toselectively outputting mono and/or stereo visual display from one ormore graphical content sources, enabling exhibition of content in 2Dfrom mono displays and selective exhibition of 2D and/or 3D content(individually or together) from stereo displays, with the contentpotentially corresponding between displays.

DESCRIPTION OF RELATED ART

Mono displays may deliver content rendered from a single perspective orpoint of view. Examples may include screens for smart phones, tablets,laptop computers, desktop monitors, and so forth. For mono displays, thecontent as displayed may appear two dimensional or “flat”. Even if thecontent source is three dimensional, such as a model of a threedimensional object or environment, rendering and display result inoutput that is or that at least appears to be two dimensional.

Stereo displays, by contrast, may deliver content rendered from twoperspectives. For example, a stereo head mounted display may have a leftscreen and a right screen, such that when the left screen is visible toa viewer's left eye and the right screen is visible to a viewer's righteye, the user may visually “fuse” the two images to perceive anappearance of depth. In such manner, three dimensional content may bedelivered with the appearance of three dimensionality.

However, delivery of content may present difficulties if the contentvaries in dimensionality (e.g. some content is 2D while some is 3D,content varies over time between 2D and 3D, content is 2D for one devicebut 3D for another, etc.), and/or if a controller for delivering contentis adapted only for supporting one type of content (e.g. mono contentonly, stereo content only, etc.). For example, for a mobile operatingsystem adapted specifically to deliver mono output to a mono display(e.g. on a smart phone), addressing a stereo display and/or facilitatingstereo output thereto may be problematic, even if a stereo display weremade available. The mobile operating system in such an example may beunsuited for handling stereo content (e.g. for processing left and rightstereo feeds rather than a single mono feed, etc.), or for mixedmono/stereo content, etc. Conversely, for a controller adaptedspecifically to deliver stereo output to a stereo display (e.g. a headmounted display), addressing a mono display and/or facilitating outputthereto likewise may be problematic.

BRIEF SUMMARY OF THE INVENTION

This disclosure contemplates a variety of systems, apparatus, methods,and paradigms for mono, stereo, and/or combined mono/stereo display.

In one embodiment, a machine-implemented method is provided thatincludes establishing a mono controller on a processor, establishing astereo controller on the processor in communication with the monocontroller, disposing left and right stereo displays in communicationwith the stereo controller and disposing at least one graphical contentsource in communication with the mono controller. The method includes atleast one of the mono controller and the stereo controller establishinga mono perspective, and the stereo controller establishing a stereoconfiguration, invoking establishing of a left stereo perspective and aright stereo perspective, and invoking establishing of a dimensionalitystatus of each graphical content source. The stereo controller invokesestablishing a left surface buffer compatible with the mono controllerand a right surface buffer compatible with the mono controller, andinvokes establishing a left image buffer compatible with the monocontroller and a right image buffer compatible with the mono controller.

In certain embodiments, for each content source with a 2D status, thestereo controller invokes rendering of a left surface therefrom with themono perspective into the left surface buffer and a right surfacetherefrom with the mono perspective into the right surface buffer. Foreach content source with a 3D status, the stereo controller invokesrendering a left surface therefrom with the left stereo perspective intothe left surface buffer and a right surface therefrom with the rightstereo perspective into the right surface buffer. The stereo controllerinvokes compositing of the left surfaces in the left surface buffer andof the right surfaces in the right surface buffer, and invokes mergingof the left surfaces to a left image into the left image buffer and ofthe right surfaces to a right image into the right image buffer. Themethod includes the stereo controller outputting the left image to theleft stereo display, and the right image to the right stereo display.

The method may include the stereo display exhibiting 2D content from thecontent sources in 2D in conjunction with 3D content from the contentsources in 3D. The stereo display may exhibits at least a portion of the3D content in a window, with at least a portion of the 2D contentoutside the window.

The mono controller may be responsive to mono controller input deliveredthereto. The mono controller input may invoke changing the content ofthe mono image. The mono controller input may invokes changing 3Dcontent of the mono image. The mono controller input may include touchscreen input.

The stereo controller may be responsive to stereo controller inputdelivered thereto. The stereo controller input may invoke changing thecontent of the mono image. The stereo controller input may invokechanging 3D content of the mono image. The stereo controller input mayinclude free space manual input.

Invoking rendering may include the mono controller rendering, the stereocontroller rendering, and/or a further data entity in communication withthe mono controller and/or the stereo controller rendering. Invokingcompositing may include the mono controller compositing, the stereocontroller compositing, and/or a further data entity in communicationwith the mono controller and/or the stereo controller compositing.Invoking merging may include the mono controller merging, the stereocontroller merging, and/or a further data entity in communication withthe mono controller and/or the stereo controller merging.

Invoking rendering may include the stereo controller calling the monocontroller to render, invoking compositing may include the stereocontroller calling the mono controller to composite, and invokingmerging may include the stereo controller calling the mono controller tomerge.

The stereo controller calling the mono controller to render may includethe stereo controller defining a virtual display for rendering by themono controller, the stereo controller calling a render function withinthe mono controller, the stereo controller activating executableinstructions for rendering in the mono controller, and/or the stereocontroller copying and executing executable instructions for renderingfrom the mono controller.

The stereo controller calling the mono controller to composite mayinclude the stereo controller defining a virtual display for compositingby the mono controller, the stereo controller calling a compositefunction within the mono controller, the stereo controller activatingexecutable instructions for compositing in the mono controller, and/orthe stereo controller copying and executing executable instructions forcompositing from the mono controller.

The stereo controller calling the mono controller to merge may includethe stereo controller defining a virtual display for merging by the monocontroller, the stereo controller calling a merge function within themono controller, the stereo controller activating executableinstructions for merging in the mono controller, and/or the stereocontroller copying and executing executable instructions for mergingfrom the mono controller.

The processor may be disposed in a mobile device. The processor may bedisposed in a smart phone and/or a head mounted display.

The mono controller may include a mobile operating system.

The graphical content source may include a 2D interface, a 2D model, a2D icon, a 2D menu, a 2D meter, 2D augmented reality information, 2Dvirtual reality information, a 3D interface, a 3D model, a 3D icon, a 3Dmenu, a 3D meter, 3D augmented reality information, and/or 3D virtualreality information.

Establishing the stereo controller on the processor may not alter themono controller. The stereo controller may not interfere with anoperation of the mono controller.

In another embodiment, an apparatus is provided that includes aprocessor, at least one graphical content source in communication withthe processor, left and right stereo displays in communication with theprocessor, a mono controller including executable instructionsinstantiated on the processor, and a stereo controller includingexecutable instructions instantiated on the processor. The monocontroller includes a graphical content communicator adapted to disposethe graphical content source(s) in communication with the monocontroller, a mono perspective establisher adapted to establish a monoperspective, a mono surface buffer establisher adapted to establish amono surface buffer including at least one mono surface, a mono imagebuffer establisher adapted to establish a mono image buffer, a monosurface renderer adapted to render the graphical content sources to themono surface buffer from the mono perspective, a mono surface compositoradapted to composite the mono surface(s), and a mono image mergeradapted to merge the mono surface(s) to a mono image in the mono imagebuffer. The stereo controller includes a mono controller communicatoradapted to communicate with the mono controller, a perspective invokeradapted to invoke establishing of a mono perspective and/or a left and aright stereo perspective, a surface buffer invoker adapted to invokeestablishing of left and right surface buffers including at least oneleft and right surface respectively with the left and right surfacebuffers being compatible with the mono surface buffer, an image bufferinvoker adapted to invoke establishing of left and right image bufferscompatible with the mono image buffer, a surface renderer invokeradapted to invoke rendering of the graphical content sources from themono perspective to the left and right surface buffers for the 2Dgraphical content sources and to invoke rendering of the 3D graphicalcontent sources from the left and right perspectives to the left andright stereo surface buffers respectively, a surface compositor invokeradapted to invoke compositing of the left and right surfaces in the leftand right surface buffers respectively, an image merger invoker adaptedto invoke merging of the left and right surfaces to a left image in theleft image buffer and a right image in the right image bufferrespectively, and a stereo outputter adapted to output the left image tothe left stereo display and the right image to the right stereo display.

The apparatus may include a body, the processor and the left and rightstereo displays disposed on the body, with wherein the body adapted tobe worn on a wearer's such that the left and right stereo displays aredisposed substantially in front of, substantially facing toward, andproximate the eyes of the wearer so as to enable stereo output thereto.

In another embodiment, a machine-implemented method is provided thatincludes instantiating a mobile operating system on a processor of amobile electronic device, instantiating a stereo controller on theprocessor in communication with the mobile operating system, disposingleft and right stereo displays in communication with the stereocontroller, and disposing at least one graphical content source incommunication with the mobile operating system. The method includes themobile operating system defining a mono perspective, and the stereocontroller defining a stereo configuration and defining left and rightstereo perspectives. The method includes the stereo controller queryingthe mobile operating system for a dimensionality status of eachgraphical content source. The stereo controller calls the mobileoperating system to define a left surface buffer, to define a rightsurface buffer, to define a left image buffer, and to define a rightimage buffer. For each 2D content source, the stereo controller callsthe mobile operating system to render a left surface therefrom with themono perspective into the left surface buffer and to render a rightsurface therefrom with the mono perspective into the right surfacebuffer. For each 3D content source, the stereo controller calls themobile operating system to render a left surface therefrom with the leftperspective into the left surface buffer and to render a right surfacetherefrom with the right perspective into the right surface buffer. Thestereo controller calls the mobile operating system to composite theleft surfaces in the left surface buffer, to composite the rightsurfaces in the right surface buffer, to merge the left surfaces to aleft image in the left image buffer, and to merge the right surfaces toa right image in the right image buffer. The method includes the stereocontroller outputting the left image to the left stereo display andoutputting the right image to the right stereo display.

In another embodiment, an apparatus is provided that includes means forestablishing a mono controller on a processor, means for establishing astereo controller on the processor in communication with the monocontroller, means for disposing left and right stereo displays incommunication with the stereo controller, and means for disposing atleast one graphical content source in communication with the monocontroller. The apparatus includes means in the mono controller and/orthe stereo controller for establishing a mono perspective. The apparatusincludes means in the stereo controller for establishing a stereoconfiguration, means in the stereo controller for invoking establishingof a left stereo perspective and a right stereo perspective, means inthe stereo controller for invoking establishing of a dimensionalitystatus of each graphical content source in communication with the monocontroller, means in the stereo controller for invoking establishing ofa left surface buffer compatible with the mono controller, means in thestereo controller for invoking establishing of a right surface buffercompatible with the mono controller, means in the stereo controllerinvoking for establishing of a left image buffer compatible with themono controller, and means in the stereo controller for invokingestablishing of a right image buffer compatible with the monocontroller. The apparatus includes means in the stereo controller forinvoking rendering of a left surface with the mono perspective into theleft surface buffer for each of the 2D content sources, means in thestereo controller for invoking rendering of a left surface with the leftperspective into the left surface buffer for each of the 3D contentsources, means in the stereo controller for invoking rendering of aright surface with the mono perspective into the right surface bufferfor each of the 2D content sources, and means in the stereo controllerfor invoking rendering of a right surface with the right perspectiveinto the right surface buffer for each of the 3D content sources. Theapparatus further includes means in the stereo controller for invokingcompositing of the left surfaces in the left surface buffer, means inthe stereo controller for invoking compositing of the right surfaces inthe right surface buffer, means in the stereo controller for invokingmerging of the left surfaces to a left image into the left image buffer,and means in the stereo controller for invoking merging of the rightsurfaces to a right image into the right image buffer. The apparatusalso includes means in the stereo controller for outputting the leftimage to the left stereo display, and the right image to the rightstereo display.

In another embodiment, a machine-implemented method is provided thatincludes establishing a mono controller on a processor, establishing astereo controller on the processor in communication with the monocontroller, disposing a mono display in communication with the monocontroller, disposing left and right stereo displays in communicationwith the stereo controller, and disposing at least one graphical contentsource in communication with the mono controller. The method includesthe mono controller and/or the stereo controller establishing a monoperspective, the stereo controller establishing a stereo configuration,the stereo controller invoking establishing of a left stereo perspectiveand a right stereo perspective, and the stereo controller invokingestablishing of a dimensionality status of each graphical contentsources in communication with the mono controller. The mono controllerestablishes a mono surface buffer, and the stereo controller invokesestablishing of a left surface buffer compatible with the monocontroller and a right surface buffer compatible with the monocontroller. The mono controller establishes a mono image buffer, and thestereo controller invokes establishing of a left image buffer compatiblewith the mono controller and a right image buffer compatible with themono controller. For each content source the mono controller renders amono surface therefrom from the mono perspective into the mono surfacebuffer. For each content source having 2D status, the stereo controllerinvokes rendering of a left surface therefrom with the mono perspectiveinto the left surface buffer and a right surface therefrom with the monoperspective into the right surface buffer. For each content sourcehaving 3D status, the stereo controller invokes rendering of a leftsurface therefrom with the left stereo perspective into the left surfacebuffer and a right surface therefrom with the right stereo perspectiveinto the right surface buffer. The mono controller composites the monosurfaces in the mono surface buffer, and the stereo controller invokescompositing of the left surfaces in the left surface buffer and theright surfaces in the right surface buffer. The mono controller mergesthe mono surfaces to a mono image in the mono image buffer, and thestereo controller invokes merging of the left surfaces to a left imageinto the left image buffer and the right surfaces to a right image intothe right image buffer. The method includes the mono controlleroutputting the mono image to the mono display, and the stereo controlleroutputting the left image to the left stereo display and the right imageto the right stereo display.

The stereo display may exhibit 2D content from the content sources in 2Din conjunction with 3D content from the content sources in 3D. Thecontent exhibited by the stereo display may substantially correspondswith the content exhibited by the mono display. The stereo display mayexhibits at least a portion of the 3D content in a window, with at leasta portion of the 2D content outside the window.

The mono controller may be responsive to mono controller input deliveredthereto. The mono controller input may invoke changing content of themono image. The mono controller input may invoke changing 3D content ofthe mono image. The mono controller input may include touch screeninput.

The stereo controller may be responsive to stereo controller inputdelivered thereto. The stereo controller input may invokes changingcontent of the mono image. The stereo controller input may invokechanging 3D content of the mono image. The stereo controller input mayinclude free space manual input.

Invoking rendering may include the mono controller rendering, the stereocontroller rendering, and/or a further data entity in communication withat the mono controller and/or the stereo controller rendering. Invokingcompositing may include the mono controller compositing, the stereocontroller compositing, and/or a further data entity in communicationwith at the mono controller and/or the stereo controller compositing.Invoking merging may include the mono controller merging, the stereocontroller merging, and/or a further data entity in communication withat the mono controller and/or the stereo controller merging.

Invoking rendering may include the stereo controller calling the monocontroller to render, invoking compositing may include the stereocontroller calling the mono controller to composite, and invokingmerging may include the stereo controller calling the mono controller tomerge.

The stereo controller calling the mono controller to render may includethe stereo controller defining a virtual display for rendering by themono controller, the stereo controller calling a render function withinthe mono controller, the stereo controller activating executableinstructions for rendering in the mono controller, and/or the stereocontroller copying and executing executable instructions for renderingfrom the mono controller.

The stereo controller calling the mono controller to composite mayinclude the stereo controller defining a virtual display for compositingby the mono controller, the stereo controller calling a compositefunction within the mono controller, the stereo controller activatingexecutable instructions for compositing in the mono controller; and/orthe stereo controller copying and executing executable instructions forcompositing from the mono controller.

The stereo controller calling the mono controller to merge may includethe stereo controller defining a virtual display for merging by the monocontroller, the stereo controller calling a merge function within themono controller, the stereo controller activating executableinstructions for merging in the mono controller, and/or the stereocontroller copying and executing executable instructions for mergingfrom the mono controller.

The processor may be disposed in a mobile device. The processor may bedisposed in a smart phone and/or a head mounted display.

The mono controller may include a mobile operating system.

The graphical content sources may include a 2D interface, a 2D model, a2D icon, a 2D menu, a 2D meter, 2D augmented reality information, 2Dvirtual reality information, a 3D interface, a 3D model, a 3D icon, a 3Dmenu, a 3D meter, 3D augmented reality information, and/or 3D virtualreality information.

Establishing the stereo controller on the processor may not alter themono controller. The stereo controller may not interfere with anoperation of the mono controller.

In another embodiment, an apparatus is provided that includes aprocessor, at least one graphical content source in communication withthe processor, a mono display in communication with the processor, leftand right stereo displays in communication with the processor, a monocontroller including executable instructions instantiated on theprocessor, and a stereo controller including executable instructionsinstantiated on the processor. The mono controller includes a graphicalcontent communicator adapted to dispose the graphical content source(s)in communication with the mono controller, a mono perspectiveestablisher adapted to establish a mono perspective, a mono surfacebuffer establisher adapted to establish a mono surface buffer includingat least one mono surface, a mono image buffer establisher adapted toestablish a mono image buffer, a mono surface renderer adapted to renderthe graphical content sources to the mono surface buffer from the monoperspective, a mono surface compositor adapted to composite the monosurface(s), a mono image merger adapted to merge the mono surface(s) toa mono image in the mono image buffer, and a mono outputter adapted tooutput the mono image to the mono display. The stereo controllerincludes a mono controller communicator adapted to communicate with themono controller, a perspective invoker adapted to invoke establishing ofleft and right stereo perspectives, a surface buffer invoker adapted toinvoke establishing of left and right surface buffers including at leastone left and right surface respectively with the left and right surfacebuffers being compatible with the mono surface buffer, an image bufferinvoker adapted to invoke establishing of left and right image bufferscompatible with the mono image buffer, a surface renderer invokeradapted to invoke rendering of the graphical content sources from themono perspective to the left and right surface buffers for the graphicalcontent sources exhibiting 2D graphical content and to invoke renderingof the graphical content sources from the left and right perspectives tothe left and right stereo surface buffers respectively for the graphicalcontent sources exhibiting 3D graphical content, a surface compositorinvoker adapted to invoke compositing of the left and right surfaces inthe left and right surface buffers respectively, an image merger invokeradapted to invoke merging of the left and right surfaces to a left imagein the left image buffer and a right image in the right image bufferrespectively, and a stereo outputter adapted to output the left image tothe left stereo display and the right image to the right stereo display.

The apparatus may include a body, the processor and the left and rightstereo displays being disposed on the body, the body being adapted to beworn on a wearer's head such that the left and right stereo displays aredisposed substantially in front of, substantially facing toward, andproximate eyes of the wearer so as to enable stereo output thereto. Inanother embodiment, a machine-implemented method is provided thatincludes instantiating a mobile operating system on a processor of amobile electronic device, instantiating a stereo controller on theprocessor in communication with the mobile operating system, disposing amono display in communication with the mono controller, disposing leftand right stereo displays in communication with the stereo controller,and disposing at least one graphical content source in communicationwith the mobile operating system. The mobile operating system defines amono perspective, and the stereo controller defines a stereoconfiguration and left and right stereo perspectives.

According to certain embodiments, the stereo controller queries themobile operating system for a dimensionality status of the graphicalcontent source(s) in communication with the mobile operating system. Themono controller defines a mono surface buffer, and the stereo controllercalls the mobile operating system to define a left surface buffer and aright surface buffer. The mobile operating system defines a mono imagebuffer, and the stereo controller calls the mobile operating system todefine a left image buffer and a right image buffer. For each contentsource the mobile operating system renders a mono surface therefrom withthe mono perspective into the mono surface buffer. For each contentsource with a 2D status the stereo controller calls the mobile operatingsystem to render a left surface therefrom with the mono perspective intothe left surface buffer and a right surface therefrom with the monoperspective into the right surface buffer. For each content source witha 3D status the stereo controller calls the mobile operating system torender a left surface therefrom with the left perspective into the leftsurface buffer and a right surface therefrom with the right perspectiveinto the right surface buffer. The mobile operating system compositesthe mono surfaces in the mono surface buffer, and the stereo controllercalls the mobile operating system to composite the left surfaces in theleft surface buffer and the right surfaces in the right surface buffer.The mobile operating system merges the mono surfaces to a mono image inthe mono image buffer, and the stereo controller calls the mobileoperating system to merge the left surfaces to a left image in the leftimage buffer the right surfaces to a right image in the right imagebuffer. The method includes the mobile operating system outputting themono image to the mono display, and the stereo controller outputting theleft image to the left stereo display and the right image to the rightstereo display.

In another embodiment, an apparatus is provided that includes means forestablishing a mono controller on a processor, means for establishing astereo controller on the processor in communication with the monocontroller, means for disposing a mono display in communication with themono controller, means for disposing left and right stereo displays incommunication with the stereo controller, means for disposing at leastone graphical content source in communication with the mono controller,and means in the mono and/or the stereo controller for establishing amono perspective. The apparatus includes means in the stereo controllerfor establishing a stereo configuration, means in the stereo controllerfor invoking establishing of a left stereo perspective and a rightstereo perspective, and means in the stereo controller for invokingestablishing of a dimensionality status of each graphical content sourcein communication with the mono controller. The apparatus includes meansin the mono controller for establishing a mono surface buffer, and meansin the stereo controller for invoking establishing of a left surfacebuffer compatible with the mono controller and a right surface buffercompatible with the mono controller. The apparatus includes means in themono controller for establishing a mono image buffer, and means in thestereo controller invoking for establishing of a left image buffercompatible with the mono controller and a right image buffer compatiblewith the mono controller. The apparatus includes means in the monocontroller for rendering a mono surface with the mono perspective intothe mono surface buffer for each of the content sources. The apparatusalso includes means in the stereo controller for invoking rendering of aleft surface with the mono perspective into the left surface buffer foreach content source with a 2D status and a right surface with the monoperspective into the right surface buffer for each of the contentsources having a 2D status. The apparatus includes means in the stereocontroller for invoking rendering of a left surface with the leftperspective into the left surface buffer for each of the content sourceshaving a 3D status and a right surface with the right perspective intothe right surface buffer for each of the content sources having a 3Dstatus. The apparatus includes means in the mono controller forcompositing the mono surfaces in the mono surface buffer, and means inthe stereo controller for invoking compositing of the left surfaces inthe left surface buffer and the right surfaces in the right surfacebuffer. The apparatus includes means in the mono controller for mergingthe mono surfaces to a mono image into the mono image buffer, and meansin the stereo controller for invoking merging of the left surfaces to aleft image into the left image buffer and the right surfaces to a rightimage into the right image buffer. The apparatus includes means in themono controller for outputting the mono image to the mono display, andmeans in the stereo controller for outputting the left image to the leftstereo display and the right image to the right stereo display.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Like reference numbers generally indicate corresponding elements in thefigures.

FIG. 1 shows an arrangement for delivering mono-only graphical contentfrom a mono-only display, in flow chart form.

FIG. 2A through FIG. 2C show an example method for delivering stereoand/or mixed mono/stereo content from a stereo display, in flow chartform.

FIG. 3 shows an example conceptual illustration of a surface, intop-down view.

FIG. 4 shows an example conceptual illustration of a surface buffer, inperspective view.

FIG. 5 shows an example conceptual illustration of a group of surfacesin a surface buffer with renders disposed therein, in top-down view.

FIG. 6 shows another example conceptual illustration of a group ofsurfaces in a surface buffer with renders disposed therein, inperspective view.

FIG. 7 shows an example conceptual illustration of a group of surfacesin a surface buffer with renders disposed therein, having beencomposited, in perspective view.

FIG. 8 shows an example conceptual illustration of a group of surfacesin a surface buffer with renders disposed therein, having beencomposited and spatially collapsed, in perspective view.

FIG. 9 shows an example conceptual illustration of a merged image in animage buffer, in perspective view.

FIG. 10 shows an example conceptual illustration of left and rightstereo surfaces, in top-down view.

FIG. 11 shows an example conceptual illustration of left and rightstereo surface buffers, in perspective view.

FIG. 12 shows an example conceptual illustration of left and rightstereo surfaces in left and right stereo surface buffers with left andright stereo perspective renders disposed therein, in top-down view.

FIG. 13 shows another example conceptual illustration of left and rightstereo surfaces in left and right stereo surface buffers with left andright stereo perspective renders disposed therein, in perspective view.

FIG. 14 shows an example conceptual illustration of left and rightstereo surfaces in left and right stereo surface buffers with left andright stereo perspective renders disposed therein, having beencomposited, in perspective view.

FIG. 15 shows an example conceptual illustration of left and rightstereo surfaces in left and right stereo surface buffers with left andright stereo perspective renders disposed therein, having beencomposited and spatially collapsed, in perspective view.

FIG. 16 shows an example conceptual illustration of merged left andright stereo images in left and right stereo image buffers, inperspective view.

FIG. 17 shows an example stereo display, in perspective view.

FIG. 18 shows an example stereo display with left and right stereoimages outputted therefrom, in perspective view.

FIG. 19 shows left and right stereo images exhibiting mixed left andmono perspectives and mixed right and mono perspectives respectively, intop-down view.

FIG. 20A through FIG. 20C show an example method for delivering mono,stereo and/or mixed mono/stereo content from a mono display and/or astereo display, in flow chart form.

FIG. 21 shows example mono and stereo displays with mono and stereoimages outputted therefrom, in perspective view.

FIG. 22A through FIG. 22C show another example method for deliveringmono, stereo and/or mixed mono/stereo content from a mono display and/ora stereo display, in flow chart form.

FIG. 23 shows an example integral apparatus for delivering mono, stereoand/or mixed mono/stereo content from a mono and/or a stereo display, inschematic form.

FIG. 24 shows an example multi-part apparatus for delivering mono,stereo and/or mixed mono/stereo content from a mono and/or a stereodisplay, in schematic form.

FIG. 25 shows an example multi-part apparatus for delivering stereoand/or mixed mono/stereo content from a stereo display, in schematicform.

FIG. 26 shows another example multi-part apparatus for delivering stereoand/or mixed mono/stereo content from a stereo display, in schematicform.

FIG. 27 shows an example integral apparatus for delivering stereo and/ormixed mono/stereo content from a stereo display, in schematic form.

FIG. 28 shows an example apparatus for delivering stereo and/or mixedmono/stereo content from a stereo display, in perspective view.

FIG. 29 shows a block diagram of a processing system that may implementoperations of the present invention.

FIG. 30 shows an example arrangement of left and right stereo imagesexhibiting differing fields of view.

FIG. 31 shows an example combined view as may result from left and rightstereo images exhibiting differing fields of view.

DETAILED DESCRIPTION OF THE INVENTION

Mono output may be delivered using dedicated tools specifically forenabling mono output in cooperation specifically with mono displays.Stereo output also may be delivered using dedicated tools specificallyfor enabling stereo output in cooperation specifically with stereodisplays.

In addition, as described and shown herein certain embodiments mayenable selective delivery of mono, stereo, and/or mixed mono/stereooutput. Also, certain embodiments may enable such selective delivery ofmono, stereo, and/or mixed mono/stereo output at least in part throughthe use of tools that, in themselves, may be directed exclusively tomono output, exclusively from mono displays. In addition, certainembodiments may enable such selective delivery of mono, stereo, and/ormixed mono/stereo output without disabling, interfering with theoperation of, and/or modifying the aforementioned tools for mono-onlyoutput from mono-only displays (though such mono-only tools may besupplemented). Furthermore, certain embodiments may enable selectivedelivery of mono, stereo, and/or mixed mono/stereo output from stereodisplays, while enabling parallel delivery of mono-only output that isotherwise visually similar or identical from mono displays.

More concretely, consider a device with a mono display such as a smartphone, with a mobile operating system thereon supporting mono output tothe mono display; and a device with a stereo display such as a near-eyestereo head-mounted display, with stereo controller software disposedthereon. Various embodiments may selectively deliver a controlled mix ofmono and stereo content to the head mounted display. For example,certain features may be displayed in two-dimensional mono form whileother features are displayed in stereo three-dimensional form,potentially at the same time, in proximity, mutually interacting, etc.Various embodiments may utilize functions already present within themobile operating system for supporting mono output, such as renderers,compositors, etc., repurposing those functions (e.g. via the stereocontroller software) and enabling delivery of a mono/stereo output mix,even though such functions may in themselves be limited only to monooutput. Various embodiments may so repurpose such mono-only functions ofthe mobile operating system to enable mono/stereo output with the headmounted display, without necessarily requiring modification,deactivation, etc. of those mono-only functions or the mobile operatingsystem as a whole. That is, the stereo controller software may run inconjunction with the mobile operating system (possibly even on the sameprocessor), producing additional functionality—e.g. mono/stereo outputwith the head mounted display—at least in part by utilizing portions ofthe mobile operating system, without necessarily changing or requiringchanges to the mobile operating system. Various embodiments also mayenable continuing delivery of mono output by the mobile operating systemto the smart phone mono display, even with certain mono-only functionsof the mobile operating system being also re-purposed for mono/stereodisplay by the stereo controller with the head mounted display; and withthe mono/stereo output with the head mounted display being visuallysimilar or identical to the mono display output with the smart phonedisplay.

In more colloquial terms, in certain embodiments a stereo controller mayre-purpose parts of a mobile operating system or other mono controller,so as to enable selective delivery of mono and/or stereo content ratherthan mono content only. The mobile operating system may not requiremodification despite such re-purposing, and such re-purposing may notinterfere with the ongoing operation of the mobile operating system,e.g. in continuing to deliver mono output to a mono-only display.Mono/stereo output delivered from a stereo display and mono outputdelivered from a mono display may be visually similar and/or identical,except with regard to dimensionality (i.e. content delivered in stereoto the stereo display appears three dimensional, while similar contentdelivered in mono to the mono display appears two dimensional).

Thus, it is emphasized that although certain embodiments may facilitatestereo output and/or mono output, such embodiments are not necessarilylimited either to mono output alone nor to stereo output alone. Rather,embodiments may for example enable delivery of stereo output incooperation with a mono system without necessarily degrading the abilityof that mono system to provide mono output, without necessarilyrequiring that existing mono output capability be removed, replaced, ormodified, and/or while potentially taking advantage of the existing monooutput capability in enabling stereo output.

However, these are examples only, and are not limiting. More detaileddescription is provided subsequently herein.

It may be illuminating to present certain examples of uses for such anapproach (though the following should not be considered limiting).Broadly speaking, delivery of combined mono/stereo output in convenientform facilitates the addition of 3D content to 2D content. That is, a“window” of 3D content may be “dropped in” to output that is otherwise2D.

For example, in terms of a viewer experience a 3D videoconferencingwindow may be added to a 2D desktop. The person at the other end may bevisible as a 3D presence, rather than as a flat image (assuming theperson at the other end is being imaged in a manner that supports 3Doutput), even though surrounding features such as text documents, emailprograms, spreadsheets, etc. are in 2D. When the videoconference isover, the viewer may dismiss the 3D window, returning to an all 2D view.

As another example, someone assembling a piece of machinery such as anautomobile engine may call up a 3D model of that engine, so as to moreclearly view the intended positions, alignments, and/or motions ofvarious components in 3D, while still viewing instructions describingthe assembly task or providing other useful information as 2D text.

As still another example, a surgeon may view a 3D model of an organ,injury, etc. in 3D, while also keeping other information such as acardiac trace, text indicating blood pressure, etc. present in 2Darranged around the 3D window. The surgeon may then rotate the 3D modelof (for example) a patient's heart, zoom in or out, pan and tilt, etc.as needed, while the 3D model remains in the 3D window and the otherimportant 2D information remains in place and visible. He or she alsomay resize the 3D window, move the 3D window around the screen, openanother 3D window, etc., depending on what is most useful at any giventime. The surgeon might also minimize or close the 3D window to clearhis or her field of view for the surgery itself, and so forth. A highdegree of flexibility in the use of 3D content thus may be available,enabling modification of what is displayed based on changingcircumstances or changing user needs.

In addition, from the point of view of a programmer, if 3D content maybe added and manipulated through “dropping in” a 3D window into anexisting 2D environment, programming also may be simplified. Rather thanrequiring a dedicated 3D interface, or a tailor-made 3D space for eachinstance of 3D content, the programmer may call a 3D window similarly tocalling a 2D window or other available content.

Furthermore, if 3D content may be combined in such fashion with 2Dcontent, programs and other features already available for 2D contentmay remain useful as-is even with the addition of 3D content. A programthat is capable only of handling 2D information may run in one window,even as another window displays 3D content. It may not be necessary tomodify existing software, operating systems, libraries, utilities, etc.,in order to support 3D content if 2D and 3D content can be mixed.

It is emphasized that although such features may be possible and/oruseful for certain advantages, they are examples only, and embodimentsare not limited only thereto.

As a note on terminology, the term “establishing” is used broadlyherein. It is noted that to “establish” something may, depending onparticulars, refer to either or both the creation of something new (e.g.establishing a business, wherein a new business is created) and thedetermination of a condition that already exists (e.g. establishing thewhereabouts of a person, wherein the location of a person who is alreadypresent at that location is discovered, received from another source,etc.). Similarly, establishing a rendering may encompass severalpotential approaches, such as performing the rendering computationally(e.g. through the use of executable instructions instantiated on aprocessor), obtaining the rendering from a data store such as a harddrive or solid state drive, receiving the rendering via communicationwith some external device, system, etc., and so forth. Otherarrangements also may be equally suitable, and embodiments are notlimited with regard to how actions and/or entities may be established.

In addition, the terms “establish” and “invoke” are used herein to referto certain tasks being commanded and/or carried out, with meanings thatmay in cases overlap but that are not necessarily identical.

As noted, the term “establish” as used herein refers to some actionbeing taken, without consideration of “who” carries out the action.

By contrast, the term “invoke” as used herein refers to some actionbeing taken, in addition considering “who” carries out the action. Thatis, the entity that carries out the action may be (but is not requiredto be) different from the entity that commands the action, initiates theaction, or otherwise causes the action to take place. For example, astereo controller may invoke rendering of a 3D model; the stereocontroller may perform the rendering, but the rendering also may beperformed by a rendering routine within a mono controller that isdistinct from the stereo controller. In such instance the stereocontroller may not carry out the rendering (and indeed the stereocontroller itself may not even have a rendering engine or other systemfor directly rendering the model), but nevertheless the stereocontroller is causing the rendering to be carried out (and may becontrolling or overseeing the rendering, etc.), even if the monocontroller carries out the actual work of rendering.

To invoke some action does not necessarily require that the action becarried out by some other entity unless so specified, but indicates thatsome other entity may carry out the action, e.g. as commanded by theentity doing the invoking.

FIG. 1 shows an example arrangement for mono visual display, presentedherein so as to illustrate one possible manner (though not necessarilythe only manner) by which mono visual content may be delivered to a monodisplay.

In FIG. 1, a mono controller is established 102. A mono controller maybe substantially any entity adapted to deliver mono content to a monodisplay, for example performing the steps shown in FIG. 1, though notnecessarily limited by the specific steps presented as an example inFIG. 1. Broadly speaking, a mono controller oversees the delivery ofmono content (including but not limited to 2D imagery) to a viewer via adisplay suitable for such mono content. A mono controller may be and/ormay include executable instructions instantiated on a processor, forexample a mobile operating system loaded onto a processor in a mobiledevice such as a smart phone, tablet, head mounted display, etc. Asanother example, mono controllers also may include a personal computeroperating system loaded onto a processor of a desktop or laptopcomputer, etc. Other arrangements also may be suitable.

A mono display is disposed 104 in communication with the monocontroller. A mono display may be any system adapted to deliver contentin a single-perspective, i.e. “mono”, arrangement. Typically though notnecessarily, a mono display may be considered to be a “flat” or 2Ddisplay, without supporting an appearance of a depth dimension. Moreconcrete examples of mono displays may include but are not limited to aCRT monitor, an LCD display, a plasma screen, etc. Devices includingsuch mono displays may include but are not limited to smart phones,tablets, desktop PCs, laptop PCs, etc. For a mono controller thatincludes executable instructions instantiated onto a processor, forexample, disposing 104 a mono display in communication with the monocontroller may represent physically connecting a mono display to theprocessor, configuring communication protocols so that the monocontroller may address the mono display, etc. However, embodiments arenot limited with regard to either how the mono controller is disposed incommunication with the mono display, nor with regard to the nature(s) ofeither the mono controller or the mono display.

At least one graphical content source is disposed 106 in communicationwith the mono controller. A graphical content source suppliesinformation regarding graphical content to the mono controller, and/orplaces graphical content under the control of the mono controller. Forexample, a video feed, a computer model, etc. may supply graphicalinformation to the mono controller, which the mono controller mayconfigure for output to the mono display (as described subsequentlyherein).

The term “graphical content” as used herein should be understoodbroadly. For example, although text is not necessarily considered to be“graphics” in common usage, nevertheless text may be consideredgraphical content herein, at least in that text may be displayed. Thatis, text may be visible when outputted from a display, and thus forpurposes of the present disclosure is considered to be graphical contentunless otherwise specified.

Similarly, the term “graphical content source” also should be understoodbroadly. A graphical content source provides information and/or controlof information, but is not required to create or otherwise originatethat information. For example, a data store such as a hard drive maystore information rather than necessarily creating information per se,but nevertheless may provide information to a mono controller.Similarly, a communicator such as a wireless modem or wired connectionmay transmit information from elsewhere, but likewise may provideinformation to a mono controller. Thus a data store and/or acommunicator may in at least certain embodiments be considered agraphical content source, as may other devices and/or systems.

Furthermore, a graphical content source is not necessarily required tohave graphical content therein in itself. As noted a computer model maybe considered to be a graphical content source, however at least certainmodels may be entirely mathematical. That is, such a computer model maybe “nothing but numbers”, rather than necessarily being or includingcontent that is directly visible e.g. as images. As describedsubsequently, images (or other visible features) may be rendered from agraphical content source, even if the graphical content itself is notstrictly speaking a visual feature in itself.

Continuing in FIG. 1, a mono perspective is established 114 in and/or bythe mono controller. For example, if graphical content is a threedimensional model, then at least in principle the distance, direction,orientation, etc. from which that three dimensional model is to beconsidered may vary. As a more concrete example, a three dimensionalmodel of an automobile might be displayed from the front, the left side,etc., the field of view may vary so as to encompass the entire vehicleor only a small portion of the vehicle, etc. A mono perspective may beimplicit and/or inherent for at least certain content. For example, fortext the perspective may be assumed to be normal to the plane of thetext; such presumed perspectives may be considered to satisfy the stepof establishing 114 a mono perspective.

A mono surface buffer is established 116 in and/or by the monocontroller. A mono surface buffer is a defined “space” wherein graphicalsurfaces (described subsequently herein) may be stored, manipulated,etc. It is noted that the mono surface buffer may not be a space or aplace in a physical sense (though such is not prohibited), but rathermay be a logical construct for accommodating graphical surfaces. Forexample, a mono surface buffer may be or may at least include somedesignated region of processor-accessible memory. In such instance, thestep of establishing 116 the mono surface buffer may include designatingaddress(es) for memory such that the mono controller may send monosurfaces thereto, manipulate mono surfaces therein, copy or move monosurfaces and/or data regarding mono surfaces therefrom, etc. It is notedthat a mono surface buffer may include therein space for multiplesurfaces, e.g. one or more surfaces for each graphical content source.Alternately, multiple mono surface buffers may be established.

A mono image buffer is established 118 in and/or by the mono controller.A mono image buffer is a defined “space” wherein an image may be stored,manipulated, etc. As with the mono surface buffer, the mono image buffermay not be a physical space or place (though again such is notprohibited), but rather may be a logical construct.

For example, a mono image buffer may be or may at least include somedesignated region of processor-accessible memory. In such instance, thestep of establishing 118 the mono image buffer may include designatingaddress(es) for memory such that the mono controller may send monoimages thereto, manipulate mono images therein, draw mono images and/ordata regarding mono images therefrom, etc. It is noted that a mono imagebuffer may include therein space for multiple images, and/or thatmultiple mono image buffers may be established.

The term “image buffer” is used herein for clarity, in that the imagebuffer as describes serves to accept images therein. However, in certaininstances the term “frame buffer” also may be suitable, e.g. if theimages stored therein are considered to be sequential frames of a video,an updating screen, etc.

Still with reference to FIG. 1, the mono controller renders 120 thegraphical content sources to produce mono surfaces, in the monoperspective. The resulting mono surfaces are disposed within the monosurface buffer.

A mono surface may be considered to be a “view” of graphical contentfrom and/or within a graphical content source. The term “rendering” asused herein refers to the production of that view, i.e. that monosurface, from the graphical content source. The process of rendering mayvary. For example, for a graphical content source in the form of a videofeed composed of many sequential image frames, a render thereof maysimply be one of those image frames captured, copied, etc. from thevideo feed. However, as another example for a graphical content sourcein the form of a mathematical model of a 3D object or environment, arender thereof may be a graphical image based on the mathematical model,e.g. what would be “seen” of the model if the model were there to beseen (rather than being purely mathematical).

The mono controller composites 122 the mono surfaces within the monosurface buffer. Compositing includes arranging mono surfaces with regardto one another, for example specifying that some mono surfaces are “ontop of” other mono surfaces (in a logical sense, not necessarily aphysical sense), or otherwise addressing how overlapping data frommultiple mono surfaces is to be handled (e.g. considering surfaces to betransparent, etc.). Compositing may also include aligning one or moremono surfaces with respect to one another and/or to some externalstandard. Compositing further may include scaling or otherwise resizingone or more mono surfaces, for example so as to arrange for all surfacesto have a consistent size; as a more concrete example, if the monodisplay is known to include an array of pixels 640×480 in size, some orall mono surfaces may be scaled to 640×480 pixels in size so as to fillthe screen when outputted. Other operations also may be suitable.

Still referring to FIG. 1, the mono controller merges 124 the monosurfaces to form a mono image. Merging may yield the mono image directlyin the mono image buffer, but also may move the image into the monoimage buffer after generation elsewhere, etc. The term “merging” as usedherein refers to combining multiple mono image surfaces to form a singleimage therefrom. In certain instances, merging may be consideredanalogous to collapsing a “stack” of mono surfaces (and/or rendersthereon) such that some or all of the content of the mono surfaces (orat least the content thereof) therein is present within the resultingmono image. Another potentially analogous operation is the notion of“flattening” in certain graphics programs, wherein multiple “layers” arecombined into one image.

The mono controller then outputs 126 the mono image to the mono display,such that the mono image is potentially visible thereon by a viewer.

An arrangement such as that shown in FIG. 1 may exhibit certainlimitations. Notably, a mono controller as described with regard to FIG.1 may not be suited for delivering 3D content, such as stereo content.More particularly, while a mono controller in communication with a monodisplay may output images of 3D content, the content itself neverthelessmay be 2D (i.e. a “flat” image of a “solid” object may be displayed).

Mono controllers may make no provision for 3D. Thus, even if a monocontroller were put in communication with a stereo display or other 3Doutput system, the mono controller may not necessarily be capable ofdisplaying content in 3D. Indeed, if the mono controller does not havesuitable avenues for addressing 3D content, including but not limited tostereo 3D, attempting to place a stereo display in communication with amono controller may result in no content being displayed at all, orcontent being displayed incorrectly, or some other malfunction.

However, although mono controllers may have limitations with regard forexample to delivering 3D output, mono controllers nevertheless are inwide use. For example Android, iOS, Windows Mobile, etc. may be used onsmart phones, tablets, and other mobile devices, various operatingsystems may be used on laptop and desktop computers, etc. Likewise, manyapplications, libraries, plug-ins, peripherals, etc. may be configuredto cooperate with mono controllers and/or with processors having monocontrollers instantiated thereon. In addition, mono controllers mayinclude useful features in themselves, whether relating to image outputor otherwise (e.g. with regard to general file handling, input, etc.).

Furthermore, not all graphical content necessarily is either in 3D formor even well-suited for adaptation or conversion into 3D form. Thecontinued ability to display 2D content, such as certain menus, text,etc. may remain useful even if the ability to display 3D content is madeavailable. In particular, the ability to simultaneously display both 2Dand 3D content may be advantageous.

Thus, although it may be possible in principle to fully replace existingmono controllers with dedicated stereo controllers (or other 3Dcontrollers), such a full replacement may represent and/or require aconsiderable effort, may not be entirely necessary, and may presentproblems in itself (for example, “legacy” applications written for usewith a mono controller may not operate properly or at all with areplacement stereo controller).

If mono controllers already are available, it may be fruitful to add toand/or adapt existing mono controllers so as to enable stereo outputand/or mixed mono/stereo output as well, without necessarily replacing,modifying, or interfering with such mono controllers or capabilitiesthereof.

Now with reference to FIG. 2A and FIG. 2B, therein is shown an examplearrangement for stereo visual display. The method shown in FIG. 2A andFIG. 2B may in some sense be considered to be an adaptation of and/or anaddition to certain steps as previously described with regard to FIG. 1.At least certain embodiments may utilize existing “infrastructure”, e.g.a mono controller and/or functions as may be carried out in whole or inpart a mono controller, in producing new outcomes. More colloquially,stereo output may be accomplished at least partly through the use of amono controller.

It is also noted that for purposes of simplicity, the arrangement shownin FIG. 2A and FIG. 2B is specific to outputting 2D and 3D content to astereo display. Not all embodiments necessarily are limited in suchfashion, and further examples are presented subsequently hereinaddressing other arrangements, such as selective output of 2D and/or 3Dcontent to either or both of mono and stereo displays.

In FIG. 2A, a mono controller is established 202A, e.g. by instantiationof executable instructions onto a processor. Mono controllers have beendescribed previously herein with regard to FIG. 1. It is noted that themono controller and establishment 202A thereof in FIG. 2A may in itselfenable only mono output, as described with regard to FIG. 1. However, asdescribed herein for various embodiments resources of the monocontroller may be repurposed, and/or additional resources provided, soas to enable stereo output (even though the mono controller in itselfmay be incapable of and/or provide no consideration for stereo output).

Embodiments are not limited with regard to what mono controller(s) isestablished 202A, what processor (if any) the mono controller isestablished 202A on, how the mono controller is established 202A, etc.

A stereo controller is established 202BC, in communication with the monocontroller. A stereo controller may be substantially any entity adaptedto perform the steps also shown in FIG. 2A and FIG. 2B and ascribedthereto. Broadly speaking, a stereo controller oversees the delivery ofstereo content (e.g. stereo 3D imagery) to a viewer via a displaysuitable for such stereo content. A stereo controller may be and/or mayinclude executable instructions instantiated on a processor, for examplean application instantiated onto a processor in a mobile device such asa smart phone, tablet, head mounted display, etc., and in communicationwith a mobile operating system thereof. As another example, stereocontrollers also may include an application loaded onto a processor of adesktop or laptop computer and in communication with the operatingsystem thereof, etc. Other arrangements also may be suitable.

For certain embodiments, it may be useful to consider the stereocontroller as an “add on” entity, such as a computer application made upin whole or in part of executable instructions, those executableinstructions being adapted to interface with executable instructions inthe mono controller. In such instances the stereo controller maycommunicate data with the mono controller, and/or to communicateinstructions with the mono controller. As a more concrete example, thestereo controller may be adapted to call on functions within the monocontroller as may already exist therein, for example instructing themono controller to establish surface buffers, to render surfaces, etc.In some sense, certain embodiments may be considered to “spoof” the monocontroller, e.g. the stereo controller may command the mono controllerto establish a surface buffer, in similar fashion to the mono controllerestablishing a surface buffer as a step in delivering mono output (e.g.as in step 116 in FIG. 1). Thus, the stereo controller may invoke and/orreplicate certain existing functions of the mono controller, but may doso at least potentially to carry out functions other than and/or beyondthe capabilities of the mono controller alone.

More regarding such “spoofing”, replication, invocation, etc. isdescribed subsequently herein.

Typically, though not necessarily, the stereo controller may beestablished 202BC onto the same processor as a mono controller, bothbeing instantiated on that processor and being in communicationtherethrough. However, other arrangements, including but not limited toestablishing 202BC the stereo controller onto a different processor,that different processor being in communication with the monocontroller, may be equally suitable.

Still with reference to FIG. 2A, a stereo display is disposed 204BC incommunication with the stereo controller. A stereo display may be anysystem adapted to deliver content in a two-perspective stereoconfiguration (e.g. as stereo image pairs), so as to facilitate theappearance of three dimensionality to content displayed therefrom. Forexample, a near-eye head mounted display, having left and right screensconfigured to be disposed proximate to and in front of the left andright eyes respectively of a viewer, may be suitable for use as a stereodisplay. However this is an example only, and other arrangements may beequally suitable.

For a stereo controller that includes executable instructionsinstantiated onto a processor, for example, disposing 204BC a stereodisplay in communication with the stereo controller may representphysically connecting a stereo display to the processor, configuringcommunication protocols so that the stereo controller may address thestereo display, etc. However, embodiments are not limited with regard toeither how the stereo controller is disposed in communication with thestereo display, nor with regard to the nature(s) of either the stereocontroller or the stereo display.

It is noted that the mono controller is not necessarily required to bein direct communication with the stereo display. Logically, if a stereodisplay is in communication with the stereo controller, and the stereocontroller is in communication with the mono controller, then in somesense the mono controller is indeed in communication with the stereodisplay. However, direct communication between the mono controller andthe stereo display is not required (though such also is not prohibited).Thus is may not be necessary, for example, to either select or adapt themono controller so as to be capable of communicating with the stereodisplay, nor conversely to select or adapt a stereo display suitable forcommunication with the mono controller.

Continuing in FIG. 2A, at least one graphical content source is disposed206 in communication with the mono controller. Graphical content sourceshave been previously described herein with regard to mono output,however some additional comments with regard to stereo output may beilluminating. Notably, a graphical content source may be definedlogically, rather than for example physically. For example, a data storemay be considered collectively as being a single graphical contentsource, it may also be suitable to consider each file therein as adistinct graphical content source. Furthermore, for files that mayinclude both 2D and 3D information therein, it may be suitable toconsider individual 2D and/or 3D elements in a given file as beingdistinct graphical content sources. As noted, in the arrangement shownin FIG. 2A and FIG. 2B all graphical content addressed therein isconsidered to be 3D content, but this is an example only and otherarrangements may be equally suitable.

It is also noted that in step 206 the graphical content sources aredisposed in communication with the mono controller, not necessarily withthe stereo controller. Although graphical content sources may bedisposed in direct communication with the stereo controller, this is notrequired. Again, logically if a graphical content source is incommunication with the mono controller, and the stereo controller is incommunication with the mono controller, then in some sense the graphicalcontent source is also in communication with the stereo controller.However, direct communication between the graphical content sources andthe stereo controller is not required (though such also is notprohibited). Thus the stereo controller may not necessarily require orhave any capability for directly communicating with graphical contentsources.

For example, the stereo controller may not have, and may not be requiredto have, suitable drivers, protocols, libraries, etc., appropriate forthe graphical content source(s). In certain embodiments, the monocontroller may already incorporate some or all such features, such thatthe stereo controller may access relevant information from the monocontroller. Thus, capabilities of the mono controller for communicatingwith graphical content sources may be utilized, without necessarilyduplicating such features within the stereo controller.

Moving on in FIG. 2A, a stereo configuration 210 is established with thestereo controller. Stereo configuration refers to visual properties ofthe stereo display, and/or the output therefrom. For example, a givenstereo display may at least potentially accommodate a range of relativesizes and fields of view of the left and right displays with regard toone another within a stereo display, degrees of overlap between left andright displays, relative brightnesses of the left and/or right displaysand/or portions thereof, etc. In principle mono displays may bedescribed as also having a “configuration”, e.g. in terms of featuressuch as screen extent, screen resolution, etc. However step 210 is notedherein e.g. because the number of parameters for a stereo display may benotably large, and variations thereof potentially of considerablesignificance in output. For example, a stereo display typically exhibitsa separation distance between left and right screens facilitating stereovision, while a mono display typically exhibits no such feature.

Continuing in FIG. 2A, a left perspective is established 214B isestablished with the stereo controller, and a right perspective 214Calso is established with the stereo controller. The arrangement of stepsin FIG. 2A (and subsequently in FIG. 2B) is shown as two parallel tracksby way of explanation, i.e. two similar sets of steps are carried outwith regard to left and right stereo views. However, this is anillustrative arrangement only, and it is not required that steps beperformed computationally in parallel, or that steps and/or thearrangement thereof are limited unless otherwise stated.

With regard to establishing 214B a left perspective, the leftperspective represents a view of three dimensional content with regardto distance, direction, orientation, etc., as may make up one of astereo pair of views (e.g. left and right). For example, a leftperspective may be offset some distance to the left from a nominal“centerline view”, although other arrangements may be suitable.

Similarly with regard to establishing 214C a right perspective, theright perspective represents a view of three dimensional content withregard to distance, direction, orientation, etc., as may make up anotherof a stereo pair of views. For example, a right perspective may beoffset some distance to the right from a nominal “centerline view”,although again other arrangements may be suitable.

The particulars of left and right perspectives may vary, for exampledifferent embodiments may exhibit different effective distances betweenthe left and right perspectives, thus representing different stereobaselines. Embodiments are not limited as to the particulars of left andright perspectives, or how those perspectives are established. Indeed,although left and right perspectives are presented as examples, it isnot necessary for all embodiments to define stereo pairs in terms ofright and left, and other arrangements may be suitable.

As noted previously, the method shown in FIG. 2A through FIG. 2C may incertain embodiments behave at least somewhat as an “add on” for a monocontroller, and/or as a repurposing of certain functions of a monocontroller. However as may be seen, FIG. 2A through FIG. 2C do notillustrate therein direct analogs of certain steps in FIG. 1. Forexample, no step directly analogous to step 114 (establishing a monoperspective) is so illustrated.

This should not be taken to indicate that steps performed by and/or inthe mono controller are necessarily prevented or excluded by the stereocontroller, unless otherwise specified. Steps not explicitly shown inFIG. 2A through FIG. 2C may nevertheless be executed, including but notlimited to direct analogs of steps in FIG. 1. For instance, a step ofestablishing a mono perspective is not required for the example methodshown in FIG. 2A through FIG. 2C, which addresses stereo output only; amono perspective thus is of little or no relevance. However, the monocontroller established in step 202A of FIG. 2A may still establish amono perspective, even though such a step is not shown in FIG. 2Athrough FIG. 2C.

In general, the execution of steps shown in FIG. 2A through FIG. 2C togenerate stereo output does not necessarily preclude the execution ofsteps not shown in FIG. 2A through FIG. 2C. In particular, mono outputalso may be generated (and indeed the generation of both mono and stereooutput is addressed in more detail subsequently herein), and/or otherfunctions also may be carried out. Thus, for example, enabling stereooutput does not necessarily replace or prevent enabling mono output,rather enabling stereo output may supplement enabling mono output.

Now with reference to FIG. 2B, a left surface buffer is invoked 216B tobe established with the stereo controller. A left surface buffer is adefined “space” wherein graphical surfaces may be stored, manipulated,etc., at least somewhat similar in concept to the mono surface bufferdescribed with regard to step 116 in FIG. 1. Typically though notnecessarily, the left surface buffer is compatible with the monocontroller, for example having similar size, format, memoryconfiguration, etc. to a mono surface buffer as may be produced by themono controller, at least insofar as the left surface buffer would beadapted to accept surfaces as rendered by the mono controller.

With regard to the term “invoke”, it is again noted that the stereocontroller may or may not itself perform the task of establishing theleft surface buffer the left surfaces for 2D content (variousembodiments may enable either or both options). Rather, the stereocontroller may command and/or otherwise cause the mono controller toestablish a surface buffer to be utilized as the left surface buffer. Asnoted with regard to FIG. 1, a mono controller may already includesuitable capabilities for establishing surface buffers. While similarcapabilities may be present within the stereo controller, it may besuitable to rely on already-existing capabilities within the monocontroller, rather than duplicating functions.

Similarly, with regard to other uses herein of “invoke”, it should beunderstood that the term indicates that some entity may cause an actionto be taken, regardless of whether that entity or some other entitydirectly carries out that action. With regard to the preceding step, thestereo controller invokes 216B a left surface buffer to be established,but the stereo controller may or may not directly establish the leftsurface buffer in itself, e.g. possibly calling the mono controller toestablish a suitable surface buffer instead. With regard to stepssubsequently described herein, likewise image buffers may be invoked,rendering may be invoked, etc.

Still with reference to FIG. 2B, a right surface buffer similarly isinvoked 216C to be established with the stereo controller. The rightsurface buffer is again a defined “space” wherein graphical surfaces maybe stored, manipulated, etc., again at least somewhat similar in conceptto the mono surface buffer described with regard to step 116 in FIG. 1.Typically though not necessarily, the right surface buffer also iscompatible with the mono controller, for example having similar size,format, memory configuration, etc. to a mono surface buffer as may beproduced by the mono controller, at least insofar as the right surfacebuffer would be adapted to accept surfaces as rendered by the monocontroller.

However, despite potential similarities between the left and rightsurface buffers and the mono surface buffer previously described, it isnoted that in FIG. 2B the left and right surface buffers are establishedby the stereo controller. Thus the stereo controller may designateaddresses in memory for the left and right surface buffers, or similarlydefine the left and right surface buffers. Indeed, it is noted that agiven mono controller may not have the capability to create and/oraddress left and right surface buffers, or even more than one surfacebuffer generally, since a single surface buffer may be sufficient formono output (and mono controllers may not even consider the possibilityof stereo output).

A left image buffer is invoked 218B to be established with the stereocontroller. A left image buffer is a defined “space” wherein an imagemay be stored, manipulated, etc., at least somewhat similar in conceptto the mono image buffer described with regard to step 118 in FIG. 1.Typically though not necessarily, the left image buffer is compatiblewith the mono controller, for example having similar size, format,memory configuration, etc. to a mono image buffer as may be produced bythe mono controller, at least insofar as the left image buffer would beadapted to accept images as merged by the mono controller.

A right image buffer is invoked 218C to be established with the stereocontroller. The right image buffer also is a defined “space” wherein animage may be stored, manipulated, etc., at least somewhat similar inconcept to the mono image buffer described with regard to step 118 inFIG. 1. Typically though not necessarily, the right image buffer iscompatible with the mono controller, for example having similar size,format, memory configuration, etc. to a mono surface buffer as may beproduced by the mono controller, at least insofar as the right imagebuffer would be adapted to accept images as merged by the monocontroller.

Again, despite potential similarities between the left and right imagebuffers and the mono image buffer previously described, it is noted thatin FIG. 2B the left and right surface buffers are established by thestereo controller (and the mono controller may not even have thecapability to establish left and right image buffers).

Still with reference to FIG. 2B, rendering is invoked 220B1 of leftsurfaces for each 2D graphical content source, in mono perspective, withthe stereo controller.

In other words, the mono controller may already be capable of renderingsurfaces from a mono perspective (and/or from other perspectives), andthus the stereo controller may cause the mono controller to render theleft surfaces exhibiting 2D content from the mono perspective, ratherthan the stereo controller itself rendering such left surfacesinternally. The command to render the relevant surfaces may come fromthe stereo controller, but the work of rendering may be performed by themono controller.

Rendering is also invoked 220C1 of right surfaces for each 2D graphicalcontent source, in mono perspective, with the stereo controller. Againwith regard to the term “invoke”, it is noted that the stereo controllermay or may not itself perform the task of rendering 220C1 the rightsurfaces in mono perspective for those graphical content sourcesexhibiting 2D content. Rather, the stereo controller may command and/orotherwise cause the mono controller to render right surfaces fromgraphical content sources, directing those right surfaces into the rightsurface buffer.

Still with reference to FIG. 2B, rendering is invoked 220B2 of leftsurfaces for each 3D graphical content source, in left perspective, withthe stereo controller. As noted previously the stereo controller may ormay not itself perform the task of rendering 220B2 such left surfaces.

Rendering is also invoked 220C2 of right surfaces for each 3D graphicalcontent source, in right perspective, with the stereo controller. Againthe stereo controller may or may not itself perform the task ofrendering 220C2 the right surfaces.

With regard collectively to steps 220B1, 220B2, 220C1, and 220C2, it isemphasized that rendering may be carried out differently based thedimensionality of a given graphical content source. That is, for 2Dcontent rendering is carried out from a mono perspective when renderingto both left and right surface, while for 3D content rendering iscarried out from a left (e.g. left stereo) perspective when renderingleft surfaces, and is carried out from a right (e.g. right stereo)perspective when rendering right surfaces. Thus the perspectives ofvarious renders/various surfaces may be different within the left imagebuffer and the right image buffer.

Continuing in FIG. 2B, compositing is invoked 222B of the left surfacesin the left surface buffer, with the stereo controller. Again, thestereo controller may not necessarily perform the task of compositingthe left surfaces (though this is not prohibited), but may insteadcommand and/or otherwise cause the mono controller to composite the leftsurfaces. As also noted with regard to FIG. 1, a mono controller mayalready include suitable capabilities for compositing surfaces. Whilesimilar capabilities may be present within the stereo controller, it maybe suitable to rely on already-existing capabilities within the monocontroller, rather than duplicating functions.

In other words, the mono controller may already be capable ofcompositing surfaces, and thus the stereo controller may cause the monocontroller to composite the left surfaces, rather than the stereocontroller itself compositing the left surfaces internally. The commandto composite the surfaces may come from the stereo controller, but thework of compositing may be performed by the mono controller.

Compositing is also invoked 222C of the right surfaces in the rightsurface buffer, with the stereo controller. Again, the stereo controllermay not necessarily perform the task of compositing the right surfaces(though this is not prohibited), but may instead command and/orotherwise cause the mono controller to composite the right surfaces.

Merging is invoked 224B of the left surfaces in the left surface bufferwith the stereo controller, so as to yield a left image in the leftimage buffer. Again, the stereo controller may not necessarily performthe task of merging the left surfaces into a left image in the leftimage buffer (though this is not prohibited), but may instead commandand/or otherwise cause the mono controller to merge the left surfaces.As noted with regard to FIG. 1, a mono controller may already includesuitable capabilities for merging surfaces to yield an image. Whilesimilar capabilities may be present within the stereo controller, it maybe suitable to rely on already-existing capabilities within the monocontroller, rather than duplicating functions.

In other words, the mono controller may already be capable of mergingsurfaces to form an image, and thus the stereo controller may cause themono controller to merge the left surfaces, rather than the stereocontroller itself margining the left surfaces internally. The command tomerge the surfaces may come from the stereo controller, but the work ofmerging may be performed by the mono controller.

Merging is also invoked 224C of the right surfaces in the right surfacebuffer with the stereo controller, so as to yield a right image in theright image buffer. Again, the stereo controller may not necessarilyperform the task of merging the right surfaces into a right image in theright image buffer (though this is not prohibited), but may insteadcommand and/or otherwise cause the mono controller to merge the rightsurfaces.

Moving on to FIG. 2C, the stereo controller then outputs 126B the leftimage to the left display of the stereo display, such that the leftimage is potentially visible thereon to the left eye of a viewer. Thestereo controller also outputs 126C the right image to the right displayof the stereo display, such that the right image is potentially visiblethereon to the right eye of a viewer. With the stereo display adapted todisplay stereo image pairs (as noted above with regard to step 204BC)and a suitable stereo configuration established (as noted above withregard to step 210), the stereo display may output imagery such that aviewer thereof may perceive that imagery as appearing three dimensional.

Although FIG. 2C shows the method therein as being complete followingsteps 226B and 226C it is emphasized that the method in FIG. 2A throughFIG. 2C is an example only. Other steps, other functions, etc. may beincorporated into the method, and/or other methods may be executed incombination with various embodiments, including but not limited torepetition of steps already shown, e.g. in an ongoing loop thatcontinues so as to display a succession of left and right images to astereo display.

Now with regard to FIG. 3 through FIG. 9, reference has been made hereinto features and steps such as surfaces and the rendering, compositing,and merging thereof. Some additional description thereof may be useful,and FIG. 3 through FIG. 9 also present illustrations thereof. However,it is noted that this is presented for explanatory purposes, and thatsurfaces, etc. shown are not necessarily representative of anyparticular embodiment. For example, although surfaces are illustrated asbeing visible entities, surfaces may in at least some embodiments benon-visual, e.g. instead existing as digital data. Likewise, a buffermay be a defined group of memory addresses in a digital electronicprocessor, rather than a visible arrangement of visible surfaces. Thus,surfaces may not may not be visible within a buffer, the buffer itselfmay not be visible, etc.

With reference now to FIG. 3, therein is shown a conceptual illustrationof a surface 342. As shown, a surface 342 is a defined space, that spacebeing adapted to receive therein a render of graphical content. Asurface 342 may also be considered to be a “blank slate” upon whichgraphical content may be rendered. Typically though not necessarily, asthe name suggests a surface 342 may be represented by a flat,two-dimensional plane or some portion thereof. The surface 342 shown inFIG. 3 is an empty or null surface, that is, no graphical content isrendered therein. Once graphical content is rendered to a surface, therendered content therein also may in some sense be considered to “be”the surface (perhaps in the same sense as a sheet of paper may beconsidered to be the drawing thereupon), but for simplicity FIG. 3 showsonly an empty surface 342.

Embodiments are not limited with regard to what graphical content may berendered thereto. Suitable graphical content (and thus the renderthereof) may include but is not limited to text, photographs,illustrations, icons, interactive controls, etc. A surface may havesome, all, or none of the space thereof occupied by rendered content.

Embodiments also are not limited with regard to the configuration ofsurfaces. In FIG. 3, the surface 342 therein is illustrated as arectangular space defined by a dashed outline. However, in practice asurface 342 is not necessarily rectangular, is not necessarily of aparticular size or proportion, and is not necessarily bounded (visiblyor otherwise); in principle a surface may be hexagonal, circular, ofinfinite extent (and thus in some sense having no defined shape), etc.

In certain instances herein, a surface 342 may be referred to as a“thing” in itself. However, it may also be valid to consider a surface342 in as a container. That is, a surface 342 may be considered to be agraphical render in itself, or may be considered to contain a graphicalrender, being a defined space that may accept a graphical rendertherein. However, it should be understood that to at least some extent,such descriptions of surfaces (and certain other elements referred toherein) may be metaphorical. That is, since a surface 342 may be, andtypically is, defined within digital memory, a surface 342 may not beeither an actual physical space or an actual physical thing, but mayrather be a memory address or group of memory addresses, etc.

In addition, although certain examples herein may reference the use ofsurfaces, the use of surfaces (and/or surface buffers, etc.) is anexample only, and is not necessarily required for all embodiments.Surfaces may be conceptually useful, e.g. in understanding how graphicalcontent may be handled. Surfaces also may be computationally useful,e.g. as a particular mechanism for handling graphical content. However,other arrangements may be equally suitable. For example, descriptionand/or use of a render buffer, wherein renders may be disposed,composited, etc. as “naked” renders, i.e. not necessarily in or assurfaces but directly as renders, may be suitable for at least certainembodiments.

Now with reference to FIG. 4, therein conceptual illustrations ofseveral surfaces 442A through 442F are shown. As may be seen, thesurfaces 442A through 442F are shown to be grouped together in a stackconfiguration, though this is an example only, and other arrangementsmay be equally suitable. With regard to the stack configuration ofbuffer 440 as shown, it is noted that for certain embodiments there maybe no literal geometric configuration, for example if the buffer 440 andsurfaces 442A through 442F are in the form of digital data there may beno geometry associated therewith.

Collectively, the surfaces 442A through 442F form a surface buffer 440.In the example of FIG. 4, the surfaces 442A through 442F are all empty,though this is for illustration only.

Embodiments are not limited with regard to the number of surfaces thatmay be in a surface buffer 440. As shown in FIG. 4, the surface buffer440 is shown having six surfaces 442A through 442F, but this is anexample only. Indeed, a surface buffer 440 may not have any surfacestherein; a surface buffer 440 may for example be merely a defined set ofmemory addresses, with surfaces being disposed therein. Alternately,each surface maybe considered to be disposed within its own buffer, orother arrangements may be equally suitable.

In addition, although the arrangement in FIG. 4 shows a surface buffer440 wherein all of the surfaces 442A through 442F therein are of equalsize, this too is an example only, and other arrangements may be equallysuitable.

Furthermore, although FIG. 4 shows the surfaces 442A through 442Ftherein arranged in a vertical stack formation, this is illustrativeonly. Although it may be useful to consider surfaces 442A through 442Fas being stacked in such fashion (e.g. when envisioning compositing ofsurfaces, described subsequently herein), embodiments are not limited tosuch arrangements. Indeed, for embodiments wherein the surface buffer440 is a logical construct, e.g. a defined group of memory addresses, itmay not even be possible to geometrically arrange surfaces 442A through442F therein at all (nor is such required).

Now with reference to FIG. 5, therein is shown the contents of a surfacebuffer 540, namely six surfaces 542A through 542F with renders 544Athrough 544F disposed therein. In particular, renders 544A through 544Fare illustrated as a frame 544A, a menu bar 544B, a battery indicator544C, a view of 3D objects 544D, a crosshair 544E, and a time indicator544F, respectively. The renders 544A through 544F are illustrated hereinto represent graphical features as may be outputted by a mobile devicesuch as a tablet or smart phone, however the particular renders 544Athrough 544F shown in FIG. 5 are examples only. Embodiments are notlimited only to those renders 544A through 544F shown in FIG. 5, nor tosimilar renders, nor necessarily even to renders suitable for a mobiledevice.

As may be seen in FIG. 5, each render 544A through 544F is disposed on arespective surface 542A through 542F. However, it may be reasonable toconsider the renders 544A through 544F to in fact be the surfaces 542Athrough 542F (for example as a piece of paper with a drawing thereon maybe considered to be the drawing), or to at least treat renders 544Athrough 544F as similar or equivalent to surfaces 542A through 542F.Further, for certain embodiments, there may not be such a thing as anempty surface (such as surfaces 442A through 442F shown in FIG. 4), oreven an empty buffer (such as buffer 440 also shown in FIG. 4).

Thus, in certain embodiments renders 544A through 544F may be distinctfrom surfaces 542A through 542F, while in other embodiments it may beequally suitable to consider renders 544A through 544F as being surfaces542A through 542F. Other arrangements also may be equally suitable.

However, for purposes of clarity renders 544A through 544F are referredto in at least certain instances herein as being distinct untothemselves, and being disposed on surfaces 542A through 542F, ratherthan necessarily being the surfaces 542A through 542F.

The ordering of surfaces renders 544A through 544F may be organized, maybe arbitrary, may be random, etc., and embodiments are not limited withregard thereto. That is, it is not necessarily required that a frameshould be part of render 544A, or that a render of a frame 544A shouldcome before or take precedence over a render of a view of 3D objects544D, etc. Typically, though not necessarily, the ordering (if any) ofrenders and/or surfaces may be a matter of expedience, for example thefirst render in a group of renders may simply be the first render toarrive in the buffer.

Now with reference to FIG. 6, therein is shown a conceptual illustrationof a buffer 640, including several surfaces 642A through 642F therein,with renders 644A through 644F respectively disposed thereon. It ispointed out that the surfaces 642A through 642F therein and renders 644Athrough 644F thereon are arranged consecutively from top to bottom, Athrough F. (More description regarding arrangement of surfaces/rendersis presented with regard to FIG. 7, below.) As may be seen, the renders644A through 644F are shown as resembling renders 544A through 544F fromFIG. 5, including a frame 644A, a menu bar 644B, a battery indicator644C, a view of 3D objects 644D, and a time indicator 644F,respectively. In addition, although the surface 642E may be consideredto include thereon a crosshair similar to the crosshair 544E in surface542E in FIG. 5, no crosshair is visible in FIG. 6 due to occlusion.

Given the arrangement in FIG. 6, the crosshair is occluded by the viewof 3D objects 644D, and so is not visible from the perspective in FIG.6. Given the arrangement of FIG. 6, the crosshair is below the view of3D objects 644D in the stack representing the buffer 640, and so giventhe perspective of FIG. 6 the crosshair is not visible. For thearrangement shown in FIG. 6, it may be understood that the view of 3Dobjects 644D may be opaque, and may include therein blank space, suchthat the crosshair may be occluded thereby. By contrast, the centralwindow of the frame 644A is not opaque, with the menu bar 644B beingvisible therethrough. It is permissible for certain surfaces and/orrenders thereon to be fully opaque, partly opaque, fully transparent,etc., over some or all of an area thereof. In certain embodiments suchopacity (or transparency) may attach to an individual surface and/orrender, e.g. a similar view of 3D objects such as in 644D may always befully opaque over an entire area thereof. However, in other embodiments,opacity and/or other features may be uniform throughout a buffer, suchthat all surfaces and/or renders exhibit the same degree of opacity. Inyet other embodiments, opacity and/or other features may be controlledindividually, e.g. as part of compositing of a buffer.

Now with reference to FIG. 7, therein is shown another conceptualillustration of a surface buffer 740, including several surfaces 742Athrough 742F therein, with renders 744A through 744F respectivelydisposed thereon, the renders again including a frame 744A, a menu bar744B, a battery indicator 744C, a view of 3D objects 744D, a crosshair744E, and a time indicator 744F, respectively. However, although thearrangement in FIG. 7 may bear at least some resembling to thearrangement in FIG. 6, in particular with regard to what features arepresent, as may be seen the configuration of those features is differentin FIG. 7 than in FIG. 6.

Notably, the ordering of the surfaces 742A through 742F with renders744A through 744F thereon is different than in FIG. 7. In particular, inFIG. 6 surfaces are ordered (top to bottom) as 642A, 642B, 642C, 642D,642E, and 642F, while in FIG. 7 surfaces are ordered 742E, 742A, 742F,742C, 742B, and 742D (with renders arranged similarly in bothinstances). The change in ordering of surfaces 742A through 742F withinthe surface buffer 740 as shown in FIG. 7 compared with FIG. 6represents a compositing of the surfaces 742A through 742F.

As used herein, compositing refers to the arrangement of surfaces withrespect to one another and/or with respect to some external standard.FIG. 7 illustrates a simple case, wherein individual surfaces are“re-shuffled” to present a different top-to-bottom order.

For example, wherein in FIG. 6 the surface 642E (with a crosshair as maybe presumed present, but not visible due to occlusion) is second fromthe bottom of the stack representing the buffer 640, in FIG. 7 thecorresponding surface 742E with the crosshair 744E thereon is nowuppermost in the stack representing the buffer 640. That is, in thearrangement shown in FIG. 7 the crosshair 744E may be in some sense “ontop” of the other renders. Thus, the crosshair 744E (if opaque) mayitself occlude some portion of (for example) the a view of 3D objects744D, as viewed from above (wherein in FIG. 6 the view of 3D objects644D occluded the presumed crosshair). However, while the arrangement inFIG. 7 is presented as a geometric stack, this is an example only. Asimilar effect might be achieved in other embodiments by assigning some“virtual depth” or “occlusion order” feature to various surfaces and/orrenders thereon, so as to produce occlusion without necessarilyarranging surfaces and/or renders in such a stack.

In addition, as may be seen in FIG. 7 the surface 744C with batteryindicator render 744C thereon is displaced to the right relative tosurfaces 742A, 742B, 743D, and 742E. In addition, surface 742F with thetime indicator render 744F thereon is displaced to the left relative tosurfaces 742A, 742B, 743D, and 742E. Thus, considering the arrangementof the renders 744A through 744F, the battery indicator 744C may beconsidered to have shifted to the left with regard to the frame 744A,etc., while the time indicator 744F may be considered to have shifted tothe right with regard to the frame 744A, etc. In more colloquial terms,by rearranging surfaces during composition the apparent positions oftime and battery indicators have been reversed.

As may be seen, compositing of surfaces 742A through 742F may includereordering of the surfaces 742A through 742F with respect to oneanother, and lateral motions of one or more surfaces 742A through 742Fwithin their plane relative to other surfaces 742A through 742F.

However, it should also be understood that compositing may include otherfeatures. For example, some or all surfaces 742A through 742F may bemoved other than as shown, for example being rotated. Additionally, someor all surfaces 742A through 742F might be shifted to align with somemarker or standard other than the rest of the surfaces 742A through742F, e.g. shifting every surface 742A through 742F so that the rightedge thereof (or the right edge of the render 744A through 744F therein)aligns with a guide line. Surfaces may also be scaled, changed in color,etc. Surfaces also may be disregarded, for example if a surface includescontent that is only to be displayed under certain circumstances (e.g. apull down menu that has been pulled down), or surfaces may be deletedfrom a buffer altogether.

As an illustration of compositing, consider as a metaphor thatindividual surfaces may be represented by sheets of transparent acetate,renders by images applied to those sheets (e.g. drawn with pens,printed, etc.), and a buffer by the collection of such sheets. Givensuch an arrangement, in at least certain embodiments compositing may beconsidered similar to reordering the sheets, moving some upward, somedownward, etc., and to repositioning the sheets vertically and/orhorizontally so as to align the images thereon as desired. Similarly,surfaces within a buffer may be reordered and/or rearranged,repositioned with regard to one another and/or some external standard,etc.

Such an arrangement may thus begin with the configuration of surfaces642A through 642F shown in FIG. 6, and produce the configuration ofsurfaces 742A through 742F shown in FIG. 7 by re-ordering the acetatesheets; that re-ordering of sheets may be at least somewhat analogous tocompositing.

However, it is emphasized that such description is an example only, andother arrangements may be suitable. For example, compositing may includeoperations that are difficult and/or impossible with such a stack ofplastic sheets, such as changes to resolution, rotation ormirror-reversal, alteration of coloring, modification ofopacity/transparency, upward or downward scaling, changes to certainportions of a surface and/or render while leaving other portionsunchanged, etc.

Nevertheless, for at least certain embodiments it may be useful (ifperhaps not perfectly precise) to consider compositing of surfacesand/or renders thereon as being similar to rearranging those surfacesand/or renders, in a manner similar to rearranging printed sheets oftransparent acetate.

As was noted previously, the opacity/transparency of surfaces and/orrenders thereon may be controlled. Such control may take place invarious manners and at various levels, and embodiments are not limitedwith regard thereto. For example, certain renders may be always opaqueor always transparent, or may have their opacity/transparency set and/orpermanently fixed at creation. Similarly, certain surfaces may be alwaysopaque or always transparent, or may have their opacity/transparency setand/or permanently fixed at creation. Thus opacity/transparency may becontrolled at a render and/or a surface level. However, opacity may becontrolled in addition or instead for the buffer as a whole, e.g. aspart of compositing.

In addition, it is noted that a surface and/or render is not necessarilyrequired to be uniformly transparent. The surface 742A in FIG. 7 and/orthe render of a frame 744A thereon may be fully opaque for the frame744A itself, but fully transparent for the window therein. This may becontrolled for example by assigning a color value as being transparent(e.g. black, with shades of gray being partially transparent), byutilizing a channel specific to transparency, or by other approaches.

Opacity may be of particular note, for example insofar as (whenconsidering the stack as a whole) opacity may influence what is and isnot occluded, and thus what may or may not be visible. As a moreconcrete example, if the view of 3D objects 744D in FIG. 7 is opaque,and the crosshair 744E is underneath the a view of 3D objects 744D, thenthe crosshair 744E may be partly or completely occluded by a view of 3Dobjects 744D, such that the crosshair 744E is not visible or is onlypartly visible. Typically, though not necessarily, blank space within asurface may default to full transparency, so that (for example) a frame744A does not occlude the central window thereof, etc. However, this isan example only, and other arrangements may be equally suitable.

In addition, although control of opacity is described herein in somedetail, the foregoing may apply equally to other properties, e.g.resolution may be controlled in various manners and levels, etc.Embodiments are not limited in this regard.

Now with reference to FIG. 8, therein is shown another conceptualillustration of a surface buffer 840. The surface buffer includessurfaces 842A through 842F with renders 844A through 844F respectivelydisposed thereon, the renders again including a frame 844A, a menu bar844B, a battery indicator 844C, a view of 3D objects 844D, a crosshair844E, and a time indicator 844F, respectively. However, as may be seenthe buffer 840 is not illustrated as a stack, with separation betweensurfaces 842A through 842F but rather is shown collapsed. Thus thesurfaces 842A through 842F shown therein are not visuallydistinguishable, although the renders 844A through 844F nonetheless mayeach be seen.

As may be seen, certain of the renders 844A through 844F occlude othersof the renders 844A through 844F, for example part of the menu 844B isoccluded by the frame 844A, and part of the view of 3D objects 844D isoccluded by the crosshair 844E. As has been noted, factors other thanbeing geometrically “on top” may be considered when determiningocclusion and other features, for example a logical value (e.g. surfaceswith a lower number are to occlude surfaces with a higher number).

However, although the surfaces 842A through 842F in FIG. 8 arecollapsed, and may not be visually separable, nevertheless the surfaces842A through 842F remain distinct. The surfaces 842A through 842F areseparate entities from one another, being many entities rather than one.For example, as may be seen surface 842C is displaced right with regardto surfaces 842A, 842B, 842D, and 842E, and surface 842F is displacedleft with regard to surfaces 842A, 842B, 842D, and 842E. The surfaces tosurfaces 842A through 842F could be further composited, e.g. displaced,reordered, etc. in the arrangement as shown in FIG. 8.

Turning to FIG. 9, therein an arrangement at least somewhat similarvisually to that of FIG. 8 is shown. An image buffer 946 is visible,represented by a dashed outline (though in practice such an outline maynot necessarily be present), and a merged image 948 is shown thereon.The relation between the image buffer 946 and the merged image 948 inFIG. 9 may be conceptually similar to that between the surface buffer840 and the surfaces 842A through 842F in FIG. 8, in that the imagebuffer 946 is a defined “place” that may accept a merged image 948therein. However, the particular configuration of the image buffer 946in FIG. 9 may be different from that of the surface buffer 840 in FIG.8, e.g. so as to be suited to accommodate an image rather than a groupof surfaces.

The arrangement in FIG. 9 also may be visually similar to that in FIG. 8in that similar graphical features are visible in FIG. 9, e.g. a frame,a menu bar, etc. However, in FIG. 8 these visible features are inindividual renders disposed in individual surfaces; by contrast, in FIG.9 these visible features are not distinct entities, but rather have beencombined to form a single merged image 948. As may be seen in FIG. 9, noindividual surfaces analogous to those in FIG. 8 (e.g. displacedsurfaces 844C and 844F) are present. The arrangement in FIG. 9 is nolonger a group of surfaces, but a merged image 948. Thus, furthercompositing (at least as described previously with regard to theexamples in FIG. 7 and FIG. 8 above) may not be possible with thearrangement in FIG. 9; surfaces may not be reordered, etc., becausethere are no surfaces present in FIG. 9.

The process of merging may be considered to be the combination ofmultiple surfaces to form one image 948. Information may be lost inmerging; where an occluded feature in a surface may still be present, ina merged image 948 any feature that was occluded by some overlyingfeature no longer exists within the image 948; for example, the part ofthe sphere that is occluded by the crosshair not only cannot be seen,but is not part of the merged image 948 at all.

Merging may in some sense be considered analogous to the “flattening”operation in certain graphical editing programs. Where such programs mayhave different features in various layers, e.g. a base image in onelayer, added text in another layer, an artificial lighting effect inanother layer, a green-screen substitution in yet another layer, etc.,flattening reduces all such layers into a single image such as a bitmap(bmp) format image, joint photographics group (jpg) format image, aportable graphics network (png) format image, etc. Similarly, mergingthe surfaces shown in FIG. 8 may yield a single merged image 948 asshown in FIG. 9.

As noted, merging may result in the loss of data. A merged image alsomay be more difficult to edit than a stack of surfaces, since individualsurfaces may no longer be shifted, moved up or down relative to othersurfaces, etc. However, a merged image 948 may exhibit certainadvantages as well. For example, a merged image typically may representa smaller total amount of data than a stack of surfaces, and/or may havea simpler configuration (e.g. a single bitmap rather than multiplesurfaces that may include vector graphics, images of various resolutionand bit depths, etc.). Also, a merged image may be more expedient foroutput through a display; certain displays may be specifically adaptedto output images, and may either have difficulty with outputtingmultiple surfaces as surfaces or be incapable of such output altogether.

In sum, with regard collectively to FIG. 3 through FIG. 9, it may beunderstood that rendering produces a data set for/on a surface,typically though not necessarily having some visual form and/orcharacteristic (e.g. a vector graphics image, a bitmap, etc.);compositing arranges, alters, and adjusts surfaces; and merging flattenssurfaces into a single image, as may be suitable for output through adisplay.

With reference now collectively to FIG. 10 through 18 therein ispresented conceptual illustrations of an example sequence of states forstereo output, as may correspond for example with certain stepsanalogous to those illustrated in FIG. 2A through FIG. 2C. Althoughreference is made to FIG. 2A through FIG. 2C for explanatory purposes,neither the individual states shown in FIG. 10 through 18 nor thecorresponding steps in FIG. 2A through FIG. 2C are necessarily limitingwith regard to various embodiments.

Turning to FIG. 10, therein is shown conceptual images of surfaces1042-L and 1042-R (shown empty for simplicity). Surfaces have beendescribed previously herein, however, it is emphasized that in thearrangement of FIG. 10 two distinct surfaces are shown, one left surface1042-L and one right surface 1042-R. The left surface 1042-L is adaptedto receive therein a render from a left perspective, such as a leftimage in a stereo pair. The right surface 1042-R is adapted to receivetherein a render from a right perspective, such as a right image in astereo pair. In terms of structure (e.g. data configuration, for asurface implemented in a digital processor), the left and right surfaces1042-L and 1042-R may be similar or even identical. However, the leftand right surfaces 1042-L and 1042-R nevertheless may not beinterchangeable: because stereo output utilizes two images in a stereoconfiguration, it may be necessary or at least useful to make adistinction between left and right images (and/or any processes forproducing those left and right images).

With reference now to FIG. 11, therein conceptual illustrations areshown of left and right surface buffers 1140-L and 1140-R. As may beseen, each of the left and right surface buffers 1140-L and 1140-Rincludes several surfaces, e.g. as similar to the left and rightsurfaces 1042-L and 1042-R shown in FIG. 10. In particular, in thearrangement shown in FIG. 11 the surface buffers 1140-L and 1140-Rinclude six left surfaces 1142A-L through 1142F-L and six right surfaces1142A-R through 1142F-R respectively, in similar stack configurations.

The left surfaces 1142A-L through 1142F-L and right surfaces 1142A-Rthrough 1142F-R are shown empty in FIG. 11, as may be the status thereofif surface buffers 1140-L and 1140-R were initially established, e.g. asin step 216B and 216C of FIG. 2B. Thus in at least some sense thearrangement shown in FIG. 11 may be considered to represent conceptuallya state during the course of a method as shown in FIG. 2B (though thisis an example only, and is not limiting for various embodiments), aftersteps 216B and 216C have been carried out.

Now with reference to FIG. 12, therein is shown the contents of left andright surface buffers 1240-L and 1240-R. Namely, left surface buffer1240-L includes six surfaces 1242A-L through 1242F-L with renders1244A-L through 1244F-L respectively disposed therein, and right surfacebuffer 1240-R includes six surfaces 1242A-R through 1242F-R with renders1244A-R through 1244F-R respectively disposed therein.

The renders in the left surface buffer 1240-L are illustrated torepresent graphical features, namely a frame 1244A-L, a menu bar1244B-L, a battery indicator 1244C-L, a view of 3D objects, 1244D-L, acrosshair 1244E-L, and a time indicator 1244F-L.

The renders in the right surface buffer 1240-R likewise are illustratedto represent a frame 1244A-R, a menu bar 1244B-R, a battery indicator1244C-R, a view of 3D objects, 1244D-R, a crosshair 1244E-R, and a timeindicator 1244F-R.

As may be seen, the left renders 1244A-L through 12442-L in the leftsurfaces 1242A-L through 1242F-L represent similar graphical content tothe right renders 1244A-R through 1244F-R in the right surfaces 1242A-Rthrough 1242F-R. That is, both renders 1244A-L and 1244A-R show the sameframe, both renders 1244B-L and 1244B-R show the same menu bar, etc.

However, the perspective of the various renders 1244A-L through 1244F-Rand 1244A-R through 1244F-R is to be considered.

Mono displays typically may be capable of displaying content only fromone perspective at a time. Thus, when developing output for monodisplays, typically graphical content likewise may be rendered only froma single perspective. Such a mono perspective may for example representone that is normal to a plane for 2D content, some selected viewingangle for 3D content (which reveals only a 2D projection of the 3Dcontent at any time), etc. Indeed, 2D graphical content typically may besuitable for view only from such a single mono perspective. That is, itmay not be anticipated that a frame such as in renders 1244A-L and1244A-R would be viewed from the side, or at an angle, etc., rather theexpected “norm” may be to view the frame only from a perspective normalto the plane of the frame. In at least some instances no provision maybe made in the frame, or other content, for view from any otherperspective; there may be nothing to see from perspectives other than amono perspective, no way to render 2D content from any but a monoperspective, etc.

For a mono display therefor, no distinction may be necessary between 2Dand 3D content, since all content necessarily must be displayed from amono perspective.

By contrast, a stereo display may display content from multipleperspectives, e.g. a stereo pair of left and right perspectives asdelivered to left and right displays respectively, so as to produce anappearance of three dimensionality for 3D graphical content.Alternately, identical perspectives may be delivered to both left andright displays, etc. Because multiple perspectives may be outputted,multiple perspectives usefully may be rendered. Thus, the choice ofperspective when rendering may become significant.

For various embodiments, 2D graphical content may be rendered from amono perspective, for both left and right buffers 1240-L and 1240-R.(This has been noted previously with regard to steps 220B1 and 220C1 inFIG. 2B.)

This may be seen by comparing renders 1244A-L, 1244B-L, 1244C-L,1244E-L, and 1244F-L in the left surface buffer 1240-L againstcorresponding renders 1244A-R, 1244B-R, 1244C-R, 1244E-R, and 1244F-R inthe right surface buffer 1240-R. Renders 1244A-L and 1244A-R both showthe same frame, from the same mono perspective, and as such 1244A-L and1244A-R are visually similar, and may be substantially identical(ignoring rendering variations, errors, noise, etc.). Pairs of renders1244B-L and 1244B-R, 1244C-L and 1244C-R, 1244E-L and 1244E-R, and1244F-L and 1244F-R, exhibit similar resemblances, again showing thesame respective graphical content sources rendered from the same monoperspective.

However, renders 1244D-L and 1244D-R are visibly different from oneanother. Render 1244D-L shows a view of 3D objects from a leftperspective, while render 1244D-R shows a view of 3D objects from aright perspective. The graphical content source from which renders1244D-L and 1244D-R derive may be one and the same: it may be observedthat both renders 1244D-L and 1244D-R include a cube, cylinder, extrudedstar, cone, and sphere of similar sizes and shapes and in similarconfiguration. However, rendering of that graphical content source wasfrom two different perspectives, left and right, producing visiblydifferent renders 1244D-L and 1244D-R.

The visible difference between renders 1244D-L and 1244D-R illustratesthat for various embodiments, 3D graphical content may be rendered fromleft and right perspectives, from a left perspective for a surface1242D-L in the left surface buffer 1240-L and from a right perspectivefor a surface 1242D-R in the right surface buffer 1240-R. (This also hasbeen noted previously, with regard to steps 220B2 and 220C2 in FIG. 2B.)

Thus, as may be seen in FIG. 12, in rendering graphical content sourcesinto left and right surface buffers 1240-L and 1240-R, theperspective(s) for rendering are determined at least in part based onthe dimensionality of each graphical content source: 2D content may berendered from a mono perspective for both the left and right surfacebuffers 1240-L and 1240-R, while 3D content may be rendered from a leftperspective for the left surface buffer 1240-L and from a rightperspective for the right surface buffer 1240-R. This distinction is ofnote, and enables certain advantages of various embodiments, about whichmore is described subsequently herein.

The arrangement shown in FIG. 12 may be considered in at least somesense to represent conceptually a state during the course of a method asshown in FIG. 2B (though this is an example only, and is not limitingfor various embodiments), after steps 220B1, 220B2, 220C1, and 220C2have been carried out.

In particular, although the left and right renders 1244A-L, 1244B-L,1244C-L, 1244E-L, and 1244F-L and 1244A-R, 1244B-R, 1244C-R, 1244E-R,and 1244F-R that represent mono content are shown as being identical,this is not required. For example, such renders may vary in field ofview, or in other aspects; more regarding this is described subsequentlyherein with regard to FIG. 30 and FIG. 31.

Now with reference to FIG. 13, therein are shown conceptualillustrations of left and right surface buffers 1340-L and 1340-R. Theleft surface buffer 1340-L includes surfaces 1342A-L, 1342B-L, 1342C-L,1342D-L, 1342E-L, and 1342F-L with renders 1344A-L, 1344B-L, 1344C-L,1344D-L, 1344E-L, and 1344F-L respectively disposed thereon. The leftsurface buffer 1340-R similarly includes surfaces 1342A-R, 1342B-R,1342C-R, 1342D-R, 1342E-R, and 1342F-R with renders 1344A-R, 1344B-R,1344C-R, 1344D-R, 1344E-R, and 1344F-R respectively disposed thereon. Itis noted that the surfaces 1342A-L through 1242F-L and the renders1344A-L through 1344F-L disposed thereon, and the surfaces 1342A-Rthrough 1242F-R and the renders 1344A-R through 1344F-R disposedthereon, are arranged consecutively from top to bottom, A through F. Asmay be seen, renders 1344A-L through 1344F-L and renders 1344A-R through1344F-R are shown as resembling renders 1344A-L through 1344F-L andrenders 1344A-R through 1344F-R (though no crosshair is visible insurfaces 1342E-L or 13442-R due to occlusion).

Although visually different from FIG. 12 in terms of the disposition ofthe buffers 1340-L and 1340-R, the arrangement shown in FIG. 13 also maybe considered in at least some sense to represent conceptually a stateduring the course of a method as shown in FIG. 2B (though this is anexample only, and is not limiting for various embodiments), after steps220B1, 220B2, 220C1, and 220C2 have been carried out.

Only a limited number of example surfaces 1342A-L through 1342F-L and1342A-R through 1342F-R are shown in FIG. 13, and likewise in certainother examples herein, so as to maintain clarity of illustration anddescription. However, embodiments are not limited only to the surfacesand/or renders shown, nor to the number of surfaces and renders shown,nor necessarily even to surfaces and/or to renders only.

For example, as illustrated all of the example surfaces 1342A-L through1342F-L and 1342A-R through 1342F-R include what may be considered“visible” content therein, that is, renders 1344A-L through 1344F-L and1344A-R through 1344F-R that show visible imagery. However, surfacesalso may accommodate non-visible content. For example, one surface mightaccommodate a “mask”, so as to make renders and/or other content“behind”/“below” that surface translucent, faded, invisible, etc. As amore concrete example, such a mask might prevent visibility of contentbehind 3D content that is to be displayed in stereo, so that such 3Dcontent is effectively in empty space, with no other content visible inthe background. Alternately, a background may be added deliberatelywithin a surface. To continue the example above, the 3D content then mayappear to float in front of a pattern, a solid color, a subduedanimation, bright light (e.g. if the 3D content is transparent ortranslucent), etc.

Likewise, such surfaces may be tagged so as to affect only some but notall other surfaces and/or renders. Thus, a surface with a mask forclearing space around 3D content may affect all surfaces exhibitingcontent rendered from a mono perspective, regardless of the “position”of such surfaces within the buffer. Such a mask might be considered,colloquially, as “punching a hole” through all surfaces that do notinclude 3D content.

Surfaces also may apply other variations to surfaces, such asillumination, shadowing, distance blur, smoke or fog, highlighting (e.g.a color change to indicate that a 3D object is active or has beenselected), etc.

However, although such effects may be achieved through the use ofsurfaces, such effects are not limited only to being achieved throughsurfaces. To establish a clear “window” surrounding 3D content, forexample, instead of adding a mask surface certain embodiments mayinstruct content sources, programs, the mono controller, etc. to leave aclear space in some fashion. As a more concrete example, the monocontroller for a given embodiment may be instructed (e.g. by the stereocontroller) that a certain region is dedicated to some particular 3Dcontent, and that no other content (or perhaps only no 2D content) is tobe outputted thereto. In such instance, content that otherwise would beoutputted into the region reserved for 3D content may be omitted, may berelocated, etc.

Other arrangements also may be suitable.

Now with reference to FIG. 14, therein is shown another conceptualillustration of left and right surface buffers 1440-L and 1440-R. Theleft surface buffer 1440-L includes surfaces 1442A-L through 1442F-Ltherein, with renders 1444A-L through 1444F-L respectively disposedthereon, those renders including a frame 1444A-L, a menu bar 1444B-L, abattery indicator 1444C-L, a view of 3D objects 1444D-L, a crosshair1444E-L, and a time indicator 1444F-L. The right surface buffer 1440-Ralso includes several surfaces 1442A-R through 1442F-R therein, withrenders 1444A-R through 1444F-R respectively disposed thereon, thoserenders including a frame 1444A-R, a menu bar 1444B-R, a batteryindicator 1444C-R, a view of 3D objects 1444D-R, a crosshair 1444E-R,and a time indicator 1444F-R.

The arrangement in FIG. 14 is at least somewhat similar to FIG. 13,however, the ordering of left surfaces 1442A-L through 1442F-L withrenders 1444A-L through 1444F-L disposed thereon and of right surfaces1442A-R through 1442F-R with renders 1444A-R through 1444F-R disposedthereon is different than in FIG. 14 than in FIG. 13. In particular, inFIG. 13 surfaces (and renders) are ordered consecutively by letter, topto bottom. However in FIG. 14 left surfaces (and renders) are ordered1442E-L, 1442A-L, 1442F-L, 1442C-L, 1442B-L, and 1442D-L, and rightsurfaces (and renders) are ordered 1442E-R, 1442A-R, 1442F-R, 1442C-R,1442B-R, and 1442D-R

In addition, as may be seen in FIG. 14 the left and right surfaces1444C-L and 1444C-R with battery indicator renders 1444C-L and 1444C-Rthereon are displaced to the right relative to the remainder of theirrespective surface buffers 1440-L and 1440-R. Also, left and rightsurfaces 1442F-L and 1442F-R with time indicator renders 1444F-L and1444F-R thereon are displaced to the left relative to the remainder oftheir respective surface buffers 1440-L and 1440-R.

The change in ordering of left and right surfaces 1442A-L through1442F-L and 1442A-R through 1442F-R within the left and right surfacebuffers 1440-L and 1440-R and the translation of left and right surfaces1442C-L, 1442C-R, 1442F-L, and 1442F-R as shown in FIG. 14 compared withFIG. 13 represents a compositing of the left and right surfaces 1442A-Lthrough 1442F-L and 1442A-R through 1442F-R.

The arrangement shown in FIG. 14 may be considered in at least somesense to represent conceptually a state during the course of a method asshown in FIG. 2B (though this is an example only, and is not limitingfor various embodiments), after steps 222B and 222C have been carriedout.

It is noted that compositing of the left and right buffers 1440-L and1440-R as shown in FIG. 14 is substantially identical for both the leftand right buffers 1440-L and 1440-R. More particularly, the leftsurfaces 1442A-L through 1442F-L and 1442A-R through 1442F-R arereordered similarly for both the left and right buffers 1440-L and1440-R, the left and right surfaces 1442C-L and 1442C-R are translatedleft in similar directions and to similar degrees, and the left andright surfaces 1442F-L and 1442F-R are translated right in similardirections and to similar degrees. However, while compositing may besubstantially identical for left and right buffers 1440-L and 1440-R asshown in FIG. 14, identical compositing of left and right buffers is notnecessarily required for all embodiments.

Similarly, the number of surfaces in a surface buffer, the particularconfiguration of surfaces within a surface buffer, etc. may notnecessarily be identical or substantially identical for left and rightsurface buffers in any particular embodiment (although for simplicityleft and right surface buffers are shown as similar herein).

Now with reference to FIG. 15, therein is shown another conceptualillustration of a left and right surface buffers 1540-L and 1540-R. Asillustrated, the left and right surface buffers 1540-L and 1540-Rinclude surfaces 1542A-L through 1542F-L with renders 1544A-R through1544F-R and surfaces 1542A-L through 1542F-R with renders 1544A-Lthrough 1544F-R disposed thereon, respectively. However, as may be seenthe left and right surface buffers 1540-L and 1540-R are not configuredas stacks, with separation between surfaces 1542A-L through 1542F-L and1542A-R through 1542F-R; rather, the left and right surface buffers1540-L and 1540-R are shown collapsed.

However, although the surface buffers 1540-L and 1540-R are shown asvisually collapsed in FIG. 15, and may not be visually separate therein,nevertheless the surfaces 1542A-L through 1542F-L and 1542A-R through1542F-R remain distinct.

It is noted that the arrangement in FIG. 15 does not necessarilyuniquely represent a particular step from FIG. 2A through FIG. 2Cdistinct from FIG. 14; either or both of FIG. 14 and FIG. 15 may betaken as conceptually representing a state during the course of a methodas shown in FIG. 2B, after steps 222B and 222C have been carried out,that is, after invoking compositing left surfaces in a left surfacebuffer with a stereo controller, and after invoking compositing rightsurfaces in a right surface buffer with the stereo controller. As notedpreviously, surface buffers may not necessarily exist as geometricconstructs, e.g. “stacks” of surfaces, but may rather be digitalinformation, logical structures, etc. Thus, the distinction between FIG.0.14 and FIG. 0.15 may be one of illustration, rather than FIG. 14 andFIG. 15 necessarily representing two distinct steps, states, etc.

Now with reference to FIG. 16, therein an arrangement at least somewhatsimilar visually to that of FIG. 15 is shown. Left and right imagebuffers 1646-L and 1646-R are visible, represented by dashed outline(though in practice such an outline may not necessarily be present), andleft and right merged images 1648-L and 1648-R are shown thereon.

The arrangement in FIG. 16 also may be visually similar to that in FIG.15 in that similar graphical features are visible in FIG. 15 and FIG.16, e.g. a frame, a menu bar, etc. However, in FIG. 15 such visiblefeatures are in individual renders disposed in individual surfaces,while in FIG. 16 these visible features are not distinct entities, butrather have been combined to form merged. More particularly, leftrenders have been merged to form a left image 1648-L, and right rendershave been merged to form a right image 1648-R. The arrangement in FIG.16 thus is not left and right surfaces, but left and right merged images1648-L and 1648-R. Thus, further compositing of surfaces and/or rendersmay not be possible with the arrangement in FIG. 16 because there are noindividual surfaces and/or renders present in FIG. 16.

The arrangement shown in FIG. 16 may be considered in at least somesense to represent conceptually a state during the course of a method asshown in FIG. 2B (though this is an example only, and is not limitingfor various embodiments), after steps 224B and 224C have been carriedout.

Now with reference to FIG. 17, therein a stereo display 1760 is shown,including left and right displays 1764-L and 1764-R. The stereo display1760 is illustrated as a near-eye stereo head mounted display, in a formsimilar to and/or adapted to be worn in similar fashion to a pair ofglasses. However, this is an example only.

Turning to FIG. 18, another view of a stereo display 1860 again isshown, also including left and right displays 1864-L and 1864-R. Inaddition, in the arrangement of FIG. 18 the left display 1864-L is shownwith a left image 1848-L thereon, e.g. as being outputted thereto; theright display 1864-R likewise is shown with a right image 1848-Rthereon, e.g. as being outputted thereto. Thus a person wearing thestereo display 1860 may, given suitable content to images 1848-L and1848-R, view at least some portion of the images 1848-L and 1848-Routputted to the left and right displays 1864-L and 1864-R in stereo,e.g. viewing 3D content with an appearance of three dimensionality.

The arrangement shown in FIG. 18 may be considered in at least somesense to represent conceptually a state during the course of a method asshown in FIG. 2C (though this is an example only, and is not limitingfor various embodiments), after steps 226B and 226C have been carriedout.

At this point it may be illuminating to point out certain functionsand/or advantages of various embodiments, in view of the precedingdescription. It should not be considered that the functions and/oradvantages are necessarily the only such, however.

With reference to FIG. 19, therein is shown a left image 1948-L and aright image 1948-R. As may be seen, various features are visible in eachof the left and right images 1948-L and 1948-R, such as a frame 1945A-Land 1945A-R, a menu bar 1945B-L and 1945B-R, a battery indicator 1945C-Land 1945C-R, 3D objects 1945D-L and 1945D-R, a crosshair 1945E-L and1945E-R, and a time indicator 1945F-L and 1945F-R.

Through comparison of the left and right images 1948-L and 1948-R, itmay be observed therein that the frames 1945A-L and 1945A-R, menu bars1945B-L and 1945B-R, battery indicators 1945C-L and 1945C-R, acrosshairs 1945E-L and 1945E-R, and time indicators 1945F-L and 1945F-Rare at least substantially identical in the left and right images 1948-Land 1948-R. For example, the size, shape, relative positions,perspective, etc. of such features is visibly the same in both the leftand right images 1948-L and 1948-R.

Also by comparison of the left and right images 1948-L and 1948-R, itmay be observed therein that the 3D objects 1945D-L and 1945D-R thereinare visibly different between the left and right images 1948-L and1948-R. For example, the 3D objects 1945D-L in the left image 1948-Lexhibits a left perspective, that is a perspective some distance to theright of the perspective of the 3D objects 1945D-R in the right image1948-R. In other words, the left image 1948-L represents those 3Dobjects 1945D-L from a point of view some distance to the left, ascompared with the right image 1948-R (equivalently, the right image1948-R may be considered as representing the 3D objects 1945D-R from apoint of view some distance to the right as compared with the left image1948-L).

For purposes of illustration, the 3D objects 1945D-L and 1945D-R asappearing in the left and right images 1948-L and 1948-R may be taken torepresent left and right stereo views of the cube, cylinder, starextrusion, cone, and sphere. Thus, if the left and right images 1948-Land 1948-R were configured for stereo viewing, the 3D objects 1945D-Land 1945D-R may appear to a viewer as exhibiting three dimensionality.

However, the frame 1945A-L and 1945A-R, menu bar 1945B-L and 1945B-R,battery indicator 1945C-L and 1945C-R, crosshair 1945E-L and 1945E-R,and time indicators 1945F-L and 1945F-R may simultaneously appear toexhibit two dimensionality, despite the various features appearingtogether in the same images 1948-L and 1948-R. Thus, the frame 1945A-Land 1945A-R, menu bar 1945B-L and 1945B-R, battery indicator 1945C-L and1945C-R, crosshair 1945E-L and 1945E-R, and time indicators 1945F-L and1945F-R may appear as mono content with the 3D objects 1945D-L and1945D-R appearing as stereo content.

In more colloquial terms, the images 1948-L and 1948-R shown in FIG. 19may enable some content therein to appear as “flat”, and other contenttherein to appear as “3D”.

Thus, it is noted that various embodiments may deliver stereo output ofgraphical content, and simultaneously may deliver mono content. Theviewer may see a single stereoscopically combined view derived fromimages 1948-L and 1948-R, with portions of that combined view appearingas stereo 3D content, and with other portions of that same combined viewappearing as mono 2D content.

It is emphasized that the distinctions between 2D and 3D output are notarbitrary, inherent, or fixed. Rather, through selective rendering fromdifferent perspectives (e.g. mono, left, right), controlled compositingand merging, etc., graphical content may be selectively displayed as 2Dor 3D. Some portions, features, windows, etc. within a screen may beselected for output so as to exhibit a 2D appearance, while otherportions, features, windows, etc. within that screen may be selected foroutput so as to exhibit a 3D appearance, with 2D and 3D features thusappearing together on the same screen.

In practice, it may not necessarily be desirable to output 2D content in3D, e.g. by rendering left and right perspectives thereof, etc. Forexample, a flat frame such as features 1945A-L and 1945A-R in left andright images 1948-L and 1948-R may in principle be rendered from leftand right perspectives for the left and right images 1948-L and 1948-Rrespectively, rather than from a mono perspective for both left andright images 1948-L and 1948-R (as shown in FIG. 19). Such anarrangement may be possible, and is not excluded, but may not beconsidered to be of sufficient visual interest as to merit the effortinvolved, i.e. a 2D object portrayed in 3D may still “look flat”, and somay lack visual interest. Typically, though not necessarily, featuresthat are mainly or entirely two dimensional may be rendered in monoperspective and outputted in 2D, while features that are partially orentirely three dimensional may be rendered in stereo perspective andoutputted in 3D or rendered in mono perspective and outputted in 2D,depending on preferences, circumstances, etc.

It is also noted that for various embodiments, certain steps fordelivering mono and/or stereo output to a stereo display may be carriedout partly or entirely by utilizing existing systems that already may beavailable, but that may be dedicated wholly to mono output (andincapable of stereo output). For example, a mono controller as describedwith regard to FIG. 1 and FIG. 2A through FIG. 2C may include thereinexecutable instructions (and/or other “machinery”, whether physical ordata based) for rendering, for compositing, for merging, etc. Eventhough such executable instructions may themselves lack any capabilityfor stereo output, nevertheless those executable instructions may bere-purposed according to various embodiments so as to facilitate stereooutput, as described herein (e.g. through additional instructionsincorporated within a stereo controller).

Thus, it may not be necessary to modify an existing mono controller, orrelated libraries, applications, utilities, hardware, etc. Variousembodiments may enable stereo and/or mixed mono/stereo output as an “addon” feature, e.g. through the overlay of a stereo controller onto a monocontroller on an existing device, with little or no modification to themono controller itself.

It is further noted that for at least certain embodiments, givenexisting executable instructions or other systems as may already beavailable for mono output, such repurposing to enable stereo and/ormixed mono/stereo output may not necessarily affect the function of theexisting executable instructions/systems. That is, overlaying a stereocontroller onto a mono controller may not necessarily interfere with thefunctions of the mono controller itself. The mono controller may stillcontinue to deliver mono output to mono displays, may still carry outother designed functions, etc., even as the stereo controller utilizescertain resources within the mono controller for other purposes (such asstereo and/or mixed mono/stereo output).

As a more concrete example, consider a smart phone with a mobileoperating system instantiated on a processor thereof, the mobileoperating system serving as a mono controller so as to enable output ofmono content to a mono display on the smart phone. Disposing a stereocontroller in communication with the mobile operating system anddisposing a stereo display in communication with the stereo controllermay enable output of stereo and/or mixed mono/stereo content to thestereo display, and may do so without necessarily interfering with theability of the mobile operating system to deliver mono output to thesmart phone's mono display, or other functions of the mobile operatingsystem (communications, data storage and recall, running applications,etc.).

Thus, adding a stereo controller may not necessarily interfere withexisting applications, functions, etc. of the mobile operatingsystem/smart phone (nor of other mono controllers).

Furthermore, it is noted that an arrangement wherein functions such asrendering, compositing, merging, etc. are repurposed from a monocontroller so as to produce stereo and/or mixed mono/stereo output, mayachieve certain advantages e.g. in terms of providing and/or supportingstereo and/or mixed mono/stereo output. For example, if the monocontroller supports creating objects, windows, etc. for output with amono display, such a feature may carry over for stereo and/or mixedmono/stereo display.

As a more concrete example, if the mono controller supports creating awindow showing a view therein of a 3D model of a beating human heartfrom a mono perspective, then outputting that heart model in stereo maybe facilitated by the stereo controller selectively invoking renderingof the heart model from left and right perspectives into left and rightsurfaces in left and right surface buffers, etc., as previouslydescribed herein. From the point of view of a program in communicationwith the mono controller (e.g. an application running under a mobileoperating system on a smart phone), the little or no change in how thewindow is created, addressed, and otherwise “handled” may be necessary,as the “stereo part” may be overseen by the stereo controller withoutmodifying the mono controller, the heart model, the applicationdisplaying the window, etc.

Similarly, from the standpoint of program languages and/or protocols,and/or a programmer utilizing program languages and/or protocols,writing a new program or modifying an existing program also may requirelittle or no change in how such a window is to be created, addressed,etc. For example, the process for creating a window may not be sensitiveto whether that window eventually may be selected for stereo 3D output;for at least certain embodiments the interpretation of 3D content as 3D,and the selection of some or all 3D content for stereo display with anappearance of three dimensionality, may be handled within the stereocontroller at the time the content is displayed, without necessarilyrequiring specific forethought or preparation on the part of aprogrammer when writing an application.

As a more concrete example, consider a mobile operating system (or othermono controller) with some form of “wizard” or help function for“dropping in” a window of a given size, showing some form of content. Tocontinue the example of the heart above, the wizard/help function mayfacilitate creation and placement of a window simply by specifying a fewparameters such as size, corner position, etc., rather than requiring aprogrammer to write executable instructions specific to each window thatis to be created. (Such an arrangement may be referred to in someinstances by the term “syntactical sugar”, and may serve both as an aidto programmers and as a tool for standardizing behaviors, e.g. so thatall windows have certain common basic behaviors.) Given such anarrangement, a programmer may, for at least certain embodiments, stillsimply specify the size, corner position, etc., for outputting the heartmodel as stereo and/or mixed mono/stereo content from a stereo displayas for outputting the heart model as purely mono content from a monodisplay.

That is, the conventions for operating, viewing, programming, etc. maynot change, or may change only minimally, despite the addition of anability to output stereo and/or mixed mono/stereo content.

As another example, inputs for controlling an object, such as theaforementioned model of a beating heart, also may remain unchanged oronly minimally changed. That is, if a swipe across a touch-sensitivemono screen may rotate the heart model within the window, then thatswipe command and associated response of rotating the heart model alsomay apply equally to the heart as outputted to a stereo display. Forexample, “rotate” command may remain, may still be associated with a“swipe” input, etc. In at least certain embodiments some support may benecessary or at least useful within the stereo controller to maintain a“swipe to rotate” arrangement, e.g. defining parameters to identifyswipes in three dimensional free space (where the swipe originally mayhave been defined as a specific series of contacts, motions, etc. acrossa touch-sensitive screen). However, at least insofar as the monocontroller is concerned, commands for manipulating the heart model, theresponses to those commands, etc., may be similar or identicalregardless of whether output is ultimately mono to a mono display orstereo and/or mixed mono/stereo to a stereo display.

Thus, analogs to inputs for controlling 2D content may serve similarlyfor controlling 3D content. For example considering a stereo display,free space swipes may function as input similarly to how a surface swipemay function as input for a touch screen mono display. In addition, theinputs for controlling 2D content may continue to serve for controlling2D content. To continue the example above, a surface swipe to a touchscreen may still serve as input to content on the mono display, as wellas potentially also serving as input to content on the stereo display(e.g. if the content of the mono and stereo display are linked, suchthat changing one changes the other, and/or such that mono and stereodisplays are in essence showing different views of the same content).

More concretely, a touch screen swipe may rotate a 3D heart visible in2D on a mono display and/or visible in 3D on a stereo display; a freespace swipe likewise may rotate a 3D heart visible in 3D on a stereodisplay and/or visible in 2D on a mono display. This may in certainembodiments reflect a connection (e.g. the same content is beingdisplayed, in 2D on a mono display and also in 3D on a stereo display),but in other embodiments may reflect symmetry of control (e.g. similarinputs produce similar results whether interacting with mono or stereooutput), and other arrangements also may be suitable.

Such similarities may facilitate transparency of use and or programmingwhen considering stereo and/or mixed mono/stereo content to a stereodisplay as compared with mono content on a mono display. For users,programmers, etc. the appearance, manipulation, use, interfacing,control, programming, etc. for graphical content may be similar for monoand stereo systems, regardless of the display or the dimensionality ofdisplayed content. If a programmer or a user is already familiar witheither a mono or a stereo environment, experience therewith may in atleast some degree carry over. As noted with regard to the example of theheart model, for a user if a screen swipe rotates a mono view of theheart on a mono display, a free space swipe likewise may rotate a stereoview of the heart on a stereo display; similarly, for a programmer if a“wizard” produces a functioning window for a mono view of the heart on amono display, that same window (or a similar window output of by the“wizard”) likewise may be a functioning window for a stereo view of theheart on a stereo display.

However, these are examples only, and it is not required that inputsand/or behaviors for mono and stereo content be identical or evensimilar. Also, even for embodiments that are similar in such fashion,changes nevertheless may be necessary, may be implemented within thestereo controller, etc., whether to make mono and stereo interactionmore similar, less similar, or to make changes that do not affectsimilarity.

In addition, it is noted that in an arrangement wherein 2D mono and 3Dstereo content is handled as described herein, for at least someembodiments what is being displayed may be readily varied while “hot”.That is, what is displayed in mono and/or stereo may be modified whiledisplays are active. For example, a window outputting a view of a 3Dmodel in mono to a stereo display may be switched “on the fly” to beoutput in stereo. Likewise, a mono or stereo window may be added,removed, changed in size or shape, etc.

Although content may be displayed in both 2D and 3D on a stereo display,content is not limited to a “2D region” and a “3D region”. Rather, astereo display may selectively and/or controllably deliver contenthaving an appearance of either two-dimensionality (mono) orthree-dimensionality (stereo) without regard to limiting 2D or 3Dcontent to certain portions of the display. The full field of view ofthe stereo display may be stereo, the full field of view may be stereo,or some combination thereof may be exhibited; for example as shown inFIG. 16 the view of 3D shapes in the left and right images 1648-L and1648-R may appear three dimensional (being rendered from left and rightperspectives, respectively), but the crosshair in front of the 3D shapesmay appear two dimensional (being rendered only from a monoperspective). Thus, what portion(s) of the display area and/or thedisplayed content may vary actively, as controlled and selected invarious embodiments.

Now with regard to FIG. 20A through FIG. 20C, therein is shown anexample method for selectively delivering mono, stereo, and/or mixedmono/stereo content to a mono display and/or a stereo display.

In FIG. 20A, a mono controller is established 2002A. A stereo controlleralso is established 2002BC in communication with the mono controller.Graphical content sets are disposed 2006 in communication with the monocontroller.

Certain previous discussions herein (e.g. FIG. 2A through FIG. 2C) mayassume the existence of a stereo display, etc. However, this is anexample only. Various embodiments may selectively perform steps enablingoutput of mono content to a mono display, and/or steps enabling stereoand/or mixed mono/stereo content to a stereo display, based on whethersuch displays are present. For example, given an arrangement wherein nostereo display is present, it may be that no stereo content is generatedfor output, even if the stereo controller is present and could inprinciple generate stereo output. Such a situation may arise, forexample, if the mono controller and stereo controller are instantiatedon the processor of a smart phone, and the stereo display is physicallydetachable from the smart phone. For such an arrangement, if the stereodisplay is not attached to the smart phone (or otherwise is not incommunication with the stereo controller, e.g. through a wireless link),then actions necessary for stereo output may not be carried out. Thus,resources such as processor power may not be used to generate stereooutput, when such output cannot be displayed (due to the absence of thestereo display).

As an illustrative example of such arrangements, in FIG. 20A the methodshown therein splits into two branches, beginning with steps 2008A and2008BC respectively. For purposes of reference, the branch beginningwith step 2008A is referred to herein as the A branch, while the branchbeginning with step 2008BC is referred to herein as the BC branch (theBC branch subsequently also may be further divided for reference, as Band C branches described below). However, it is emphasized that thebranching structure of the method in FIG. 20A through FIG. 20C isillustrative only, and that other arrangements may be equally suitable.Steps need not necessarily be subdivided as shown into multiplebranches.

A determination is made 2008A as to whether the mono controller is incommunication with a mono display. If no mono display is present—if thedetermination 2008A is negative—then the A branch of the method ends.Simply put, if there is no mono display, there may be no advantage ingenerating output for a mono display. Similarly, a determination is made2008BC as to whether the stereo controller is in communication with astereo display. If no stereo display is present—if the determination2008BC is negative—then the BC branch of the method ends. Again, ifthere is no stereo display, there may be no advantage in generatingoutput for a stereo display.

Embodiments are not limited with regard to how or by what entity thedeterminations 2008A and 2008BC may be made. Typically though notnecessarily, a mono controller may include therein some capability fordetermining whether a mono display is in communication therewith. Alsotypically though not necessarily, the stereo controller may includetherein some capability for determining whether a stereo display is incommunication therewith. However, other arrangements, including but notlimited to arrangements wherein the stereo controller determines andboth whether a mono display is present 2008A and whether a stereodisplay is present 2008BC, may be equally suitable.

In addition, although the example method in FIG. 20A through FIG. 20Cexplicitly addresses only one mono display and one stereo display,embodiments are not necessarily so limited. Multiple mono displaysand/or multiple stereo displays may be supported, and similarly multipledeterminations 2008A and 2008BC may be made for multiple displays.

Still with reference to FIG. 20A, if the determination 2008A as to thepresence of a mono display is positive—if a mono display is indeed incommunication with the mono controller—then the A branch of the methodcontinues in FIG. 20B. If the determination 2008BC as to the presence ofa stereo display is positive—if a stereo display is in communicationwith the stereo controller—then the BC branch of the method continueswith establishing 2010 a stereo configuration with the stereocontroller. (No analogous step to 2010 is shown explicitly in FIG. 20A,although configuring mono output in some fashion is not prohibited, aspreviously noted. Typically though not necessarily, such monoconfiguring, if present, may be carried out transparently by the monocontroller. That is, insofar as the mono controller is concerned, monooutput may proceed normally, regardless of whether stereo output is alsobeing generated.)

Now with reference to FIG. 20B, in the BC branch the dimensionality ofeach graphical content source is established 2012 with the stereocontroller. (Again, no analogous step to 2012 is shown explicitly inFIG. 20B for the A branch, though such is not prohibited. The A branchaddresses mono content for a mono display, thus the dimensionality maynot affect how graphical content is handled in the A branch. That is, ifeverything must be delivered as mono output, determining whether thatoutput is 2D, 3D, etc. may be of limited consequence.)

Continuing in FIG. 20B, in the A branch a mono perspective isestablished 2014A with the mono controller. In the B branch a monoperspective also is established 2014BC with the stereo controller. Themono perspectives established in steps 2014A and 2014BC are not requiredto be identical, but may be identical or at least similar. Indeed, incertain embodiments the mono perspective may be established 2014BC bythe stereo controller by querying the mono controller for the monoperspective established 2014A thereby, by querying the mono controlleras to how the mono perspective was established 2014A thereby, etc. Suchan arrangement may be useful in at least some instances, for example ifboth a mono display and a stereo display are present then the monocontent may be handled similarly for output to both the mono display andthe stereo display. In such instances, mono content outputted from themono display may be visually similar or even indistinguishable from monocontent outputted from the stereo display. In more colloquial terms, themono and stereo displays may show mono content “the same way”, so thatviewers may perceive such content as being likewise “the same”.

However, other arrangements also may be suitable.

Again for illustrative purposes, in FIG. 20B the BC branch splits into Band C branches, with the B branch referring to output for the leftdisplay of a stereo display, and the C branch referred to output for theright display of a stereo display. Again, this is illustrative only.

In the B branch, a left perspective is established 2014B with the stereocontroller. In the C branch, a right perspective is established 2014Cwith the stereo controller. The left and right perspectives areestablished 2014B and 2014C so as to enable stereo viewing of outputgenerated in accordance therewith. (No analogous step to 2014B and 2014Cis explicitly shown for the A branch in FIG. 20B. Typically a monocontroller is not adapted to formulate and/or address multipleperspectives, as mono rendering typically uses, by definition, a single“mono” perspective.

Continuing in FIG. 20B, in the A branch a mono surface buffer isestablished 2016A with the mono controller. In the B branch a leftsurface buffer is invoked 2016B to be established with the stereocontroller. In the C branch a right surface buffer is invoked 2016C tobe established with the stereo controller.

Again in the A branch, a mono image buffer is established 2018A with themono controller. In the B branch a left image buffer is invoked 2018B tobe established with the stereo controller. In the C branch a right imagebuffer is invoked 2018C to be established with the stereo controller.

In the A branch, a mono surface is rendered 2020A for each graphicalcontent source, in mono perspective, with the mono controller. In the Bbranch, a left surface is invoked 2020B1 to be rendered for each 2Dgraphical content source, in mono perspective, with the stereocontroller. In the C branch, a right surface is invoked 2020C1 to berendered for each 2D graphical content source, in mono perspective, withthe stereo controller.

Now with reference to FIG. 20C, in the B branch, a left surface isinvoked 2020B2 to be rendered for each 3D graphical content source, inleft perspective, with the stereo controller. In the B branch, a rightsurface is invoked 2020C2 to be rendered for each 3D graphical contentsource, in right perspective, with the stereo controller. (No stepdirectly analogous to 2020B2 and 2020C2 is explicitly shown in the Abranch, though such is not prohibited. Typically for a mono source,rendering from multiple perspectives may be impossible and/or of limitedinterest, e.g. the mono content may “look the same” regardless of viewpoint, mono content may not be visually improved through rendering fromtwo perspectives as opposed to one, etc.)

It is at this point noted that embodiments do not necessarily requirethat all 3D content sources be rendered in left and right perspectives.It may be equally suitable that some or even all 3D content sources berendered as if those content sources were entirely 2D. Thus, not allnominally 3D content necessarily will be delivered to a stereo displayas stereo 3D output. Certain 3D content may be rendered in mono for soas to de-emphasize that 3D content, or due to limited processingresources, or for other reasons.

Furthermore, 3D content may be only partially rendered from left andright perspectives. For example, a large 3D environment may be splitinto several regions, such that if delivered as stereo output thecentral portion of the field of view will appear in stereo 3D, but leftand right portions of the field of view will appear in mono (2D). Again,this may serve various functions, e.g. to emphasize the central portionof the field of view, to provide an appearance of 3D output withoutconsuming the resources required for full-screen 3D output, etc.

Thus, 3D content may, in at least certain embodiments, be rendered formono output (even to a stereo display) rather than for stereo 3D output.

Other arrangements also may be equally suitable.

Still with reference to FIG. 20C, in the A branch the mono surfaces inthe mono surface buffer are composited 2022A by the mono controller. Inthe B branch the compositing of the left surfaces in the left surfacebuffer is invoked 2022B by the stereo controller. In the C branch thecompositing of the right surfaces in the right surface buffer is invoked2022C by the stereo controller.

In the A branch the mono surfaces are merged 2024A into a mono image inthe mono image buffer, by the mono controller. In the B branch themerging of the left surfaces into a left image in the left image bufferis invoked 2024B by the stereo controller. In the C branch the mergingof the right surfaces into a right image in the right image buffer isinvoked 2024C by the stereo controller.

In the A branch the mono image is outputted 2026A to a mono display withthe mono controller. In the B branch the left image is outputted 2026Bto the left display (of a stereo display) with the stereo controller. Inthe C branch the right image is outputted 2026C to the right display (ofa stereo display) with the stereo controller.

Subsequent to steps 2026A, 2026B, and 2026C respectively in branches A,B, and C, the method as shown in FIG. 20A through FIG. 20C is shown ascomplete. However, as noted previously, other steps, repetition ofsteps, etc. also may be carried out. For example, certain steps shownmay be repeated so as to output a sequence of mono, left, and rightimages so as to update graphics over time, display video, etc.

With mono output, left output, and right output deriving from similargraphical content sources, and processed and outputted as shown, for atleast certain embodiments the appearance of the output may be similar onthe mono display and the stereo display. That is, the elements that areshown (e.g. the frame, menu bar, battery indicator, 3D objects,crosshair, and time indicator as referred to in certain previousexamples) all may be present in both the mono and the stereo display,and may be configured similarly, even if on the mono display allelements are shown in 2D, while on the stereo display elements may beselectively shown in 2D and/or 3D.

For example, with reference to FIG. 21, a smart phone 2161-A is showntherein, with a mono display 2165-A and a mono image 2149-A thereon. Ahead mounted display 2160 also is shown in FIG. 21, with left and rightdisplays 2164-L and 2164-R and left and right images 2148-L and 2148-Rthereon. As may be seen, the mono image 2165-A on the mono display2165-A appears visually similar to the left and right images 2148-L and2148-R on the left and right displays 2164-L and 2164-R, e.g. exhibitingsimilar image content, similar configuration, similarvertical/horizontal ratio, similar size, etc. (although as may beobserved, the mono image 2149-A, left image 2148-L, and right image2148-R each exhibit different perspectives, e.g. a mono, left, and rightperspective respectively).

Such similarity of output among displays may be useful for at leastcertain embodiments. Output from different displays may for example bereadily comparable in such instance, if the output “looks similar” or“looks the same” regardless of whether outputted from a stereo or monodisplay (or likewise whether outputted from one of two or more monodisplays, one of two or more stereo displays, etc.). As a moreparticular example, consider an arrangement wherein output is beingviewed simultaneously by multiple persons with multiple devices, somedevices having mono displays and some having stereo displays. If thatoutput is similar in appearance regardless of device and/or regardlessof display dimensionality (mono or stereo), then at least in principleall persons involved may receive essentially the same imagery. Certainpersons may view the imagery in mono, while others view the imagery instereo and/or mixed mono/stereo, but the imagery itself may be at leastsufficiently visually similar as to facilitate common understanding. Inmore colloquial terms, if everyone sees something similar, everyone mayhave common ground for purposes of discussion, etc.

However, such similarity is an example, and is not required. As may alsobe seen in FIG. 21, another smart phone 2161-B is shown therein, withmono display 2165-B and a mono image 2149-B thereon. Although mono image2149-B bears at least some visual resemblance to left and right images2148-L and 2148-R, the mono image 2149-B is rotated 90 degreesclockwise, is larger in size, is disposed on the mono display 2165-Bsuch that not all of the mono image 2149-B is visible (e.g. the framebeing “clipped off” at the left and right edges of the mono display2165-B), etc.

Now with regard to FIG. 22A through FIG. 22C, another example method forselectively delivering mono, stereo, and/or mixed mono/stereo content ispresented. Where certain examples described previously herein haveaddressed such presentation in conceptual terms, FIG. 22A through FIG.22C and the description thereof address a more concrete example ofimplementation of such a method. The structure of FIG. 22A through FIG.22C may be at least somewhat similar to that of FIG. 20A through FIG.20C, though descriptions in FIG. 22A through FIG. 22C may address morenarrowly-defined, concrete embodiments. However, it is emphasized thatthe arrangement in FIG. 22A through FIG. 22C is also an example only,that embodiments are not limited only thereto, and that otherarrangements may be suitable.

In FIG. 22A, a mobile operating system (OS) is instantiated 2202A ontothe internal digital processor controlling a smart phone. The smartphone may be, but is not required to be, a conventional electronicdevice, except as otherwise specified herein (e.g. the presence of astereo controller according to various embodiments, etc.). Certain smartphones include integral mono displays therein, and such a mono displayis considered to be present for purposes of the example herein. A mobileoperating system typically may include therein functions adapted forcontrolling such a mono display, and for carrying out certain actionssuch as rendering, etc., and/or otherwise functioning as a monocontroller. Suitable mobile operating systems may include, but are notlimited to, Android, Windows Mobile, and iOS.

Typically though not necessarily, a mobile operating system may beinstantiated onto a smart phone processor as part of a boot routine, forexample with executable instructions being read from data storage withinthe phone, and loaded onto the processor. However, the manner by whichthe mobile operating system is instantiated onto the process is notlimiting for various embodiments.

A stereo controller is instantiated 2202BC onto the processor of thesmart phone, and disposed in communication with the mobile operatingsystem (e.g. through the processor both are instantiated upon). Thestereo controller is an assembly of executable instructions, adapted tobe instantiated onto a digital processor. The stereo controller may beconsidered an overlay onto the mobile operating system, and/or anextension thereto, in that the stereo controller may interface with,control certain functions of, and/or send information to and from, themobile operating system.

A stereo controller may be specific to a particular mobile operatingsystem. That is, a given stereo controller may be adapted to communicatewith a particular mobile operating system such as Android, while adifferent stereo controller may be adapted to communicate with someother mobile operating system, etc. However, stereo controllers adaptedto communicate with multiple distinct mobile operating systems are notexcluded.

Typically though not necessarily, the stereo controller may beinstantiated onto a smart phone processor similarly to the mobileoperating system, e.g. as part of a boot routine with executableinstructions being read from data storage within the phone, and loadedonto the processor. However, the manner by which the stereo operatingsystem is instantiated onto the process is not limiting for variousembodiments. Indeed, although in the particular example of FIG. 22A thestereo controller is instantiated onto the same processor as the mobileoperating system, in other embodiments a stereo controller may beinstantiated onto a different processor and/or a different physicaldevice (such as a piece of hardware connected to a smart phone or othersystem), may be instantiated onto a cloud system that is incommunication with the mobile operating system, etc.

Continuing in FIG. 22A, the graphics feeds are configured 2206 tocommunicate with the mobile operating system. That is, whatever graphicsare to be displayed, the sources of those graphics are to be madeavailable to the mobile operating system. This may represent readingdata from a flash drive or other data store within the smart phone,connecting the smart phone to some other device through a wired port,communicating wirelessly with some other system, etc. In certaininstances configuration may simply amount to advising the mobileoperating system that the graphics in question are available and/or areto be displayed, while in others configuration may involve matchingcommunication protocols, converting file types, accessing databases,etc. The particular details are not limiting, so long as the relevantgraphics feeds are in some manner made available for use by the mobileoperating system.

However, as a more concrete example, the mobile operating system mayaccess a video provider, so as to download streaming video therefromthrough a wireless network. As another example, a 3D model of a heartmay be located on from a flash drive or other data store by the mobileoperating system, accessed by the mobile operating system, and madeavailable for rendering (e.g. by opening an appropriate modelingapplication, reading a relevant model file directly, etc.). As yetanother example, standard graphics and protocols for generating frames,buttons, text boxes, etc. present within the mobile operating system maybe called within the mobile operating system so as to enable display ofsuch screen features. The particulars may vary considerably from oneembodiment to another, and embodiments are not limited with regard tohow graphics feeds are configured 2206, or what entity (the mobileoperating system, a user, some other entity, etc.) carries out theconfiguring.

Still with reference to FIG. 22A, the method as illustrated branchesinto an A branch and a BC branch. In the A branch, a determination 2208Ais made as to whether the integral mono display of the smart phone isactive. In certain instances the mono display may be inactive, forexample a user may disable a mono display while using a stereo displayto save power. If the mono display is inactive—if the determination2208A is negative—then the A branch of the method as shown in FIG. 22Athrough FIG. 22C is complete.

If the mono display is active—if the determination 2208A ispositive—then the A branch of the method continues in FIG. 22B.

In the BC branch, a determination 2208BC is made as to whether a headmounted display with stereo capability is present and active, e.g. is incommunication with the stereo controller. In certain instances such astereo display may not be present, and/or may be inactive. For example,even if the stereo controller is already instantiated on the smart phoneprocessor, at times a user may choose not to use a stereo display, andmay deactivate or even disconnect the stereo display. The stereocontroller nevertheless may remain instantiated on the smart phoneprocessor, in the event that a stereo display is again made available.Regardless, if the head mounted stereo display is not present or isinactive—of the determination 2208BC is negative—then the BC branch ofthe method is complete.

It is noted that although the arrangement in FIG. 22A shows branches ofthe method as being complete in the event of negative determinations in2208A and/or 2208BC, it is not necessarily required that further stepsin the relevant branches be excluded. Even if no suitable displays areavailable for mono, stereo, and/or mixed mono/stereo content, processingof such content is not prohibited. Such content may be recorded in adata store, transmitted externally, etc., or even simplyignored/deleted. However, for purposes of clarity, the examplearrangement of FIG. 22A through FIG. 22C considers that if suitabledisplays are not present, then content for such displays is notnecessarily generated.

It is also noted that although a head mounted stereo display ispresented as an example, embodiments are not limited thereto, any morethan embodiments are limited to a smart phone, etc.

If the head mounted stereo display is present and active—if thedetermination 2208BC is positive—then the BC branch of the methodcontinues with step 2210.

In the BC branch, the stereo controller defines 2210 a stereoconfiguration. This stereo configuration may represent considerationssuch as the display size of the head mounted stereo display, the eyeseparation of the user, the desired apparent stereo baseline of contentto be displayed, the degree of stereo overlap between left and righteyes (which may be but is not required to be 100%), the brightness ofthe display and/or regions thereof, the transparency of the display (ifcontrollable), etc. Stereo vision may be affected by numerous factors,and defining the stereo configuration may include any or all suchfactors.

Typically, though not necessarily, stereo configuration may bedetermined at least partially by a user, for example throughmanipulation of settings made available through the stereo controller.For example, a stereo controller may include therein settings foradjusting the effective eye spacing of displayed content (or even fordetermining such information automatically by scanning the user).However, regardless of precisely how the information may originate, solong as the stereo controller and/or some entity in communicationtherewith in some fashion acquires suitable information sufficient forenabling stereo output with a stereo display, this may be considered torepresent defining 2210 stereo configuration.

Now moving to FIG. 22B, in the BC branch the stereo controller queries2212 graphics feeds to determine the dimensionality thereof. Typicallythough not necessarily, graphics feeds and/or the graphics deliveredthereby may include therein an explicit identification of whether thecontent thereof is two dimensional, three dimensional, etc. Thus, for atleast certain embodiments querying 2212 the graphics feeds may includereading metadata, file information, a flag, etc. associated with thegraphics feeds, with the dimensionality indicated explicitly therein.However, other approaches, including but not limited to recognizing filetypes as 2D or 3D, or otherwise inspecting the files, data therein,sources of files and/or data, etc., may be equally suitable.

In addition, the mobile operating system itself may include therein somemechanism for determining the dimensionality of data. For example, itmay be useful to a mobile operating system to determine whether contentis a simple 2D button, or a complex 3D environment, so as to moreeffectively render and/or otherwise handle that content (e.g. byaccessing suitable rendering tools for the particular content, etc.).Thus, querying 2212 may in certain embodiments include the stereocontroller accessing such information from the mobile operating system,rather than the stereo controller directly evaluating the graphicsfeeds.

Typically, though not necessarily, a mobile operating system may includesome protocol for accepting and/or responding to queries about graphicalcontent. For example various programs, libraries, hardware components,etc. may query a mobile operating system in at least a somewhat similarfashion. Thus, for at least certain embodiments the query 2212 mayrepresent the stereo controller sending a common and preconfiguredcommand to the mobile operating system.

Continuing in FIG. 22B, in the A branch the mobile operating systemdefines 2214A a mono perspective. In practice the mobile operatingsystem may define 2214A more than one mono perspective, for exampledefining mono perspectives for two or more graphics feeds. As a moreconcrete example, if two different 3D objects are to be addressed by themobile operating system, it is not necessarily required that both such3D objects be viewed from the same direction, the same apparentdistance, etc. Furthermore, mono perspectives may vary over time, forexample panning, zooming, etc. in response to a command delivered by auser. However for simplicity, the mono perspective may be referred toherein in at least certain instances as being unitary and/or static.

In the BC branch, the stereo controller queries 2214BC the mobileoperating system for the mono perspective. Typically though notnecessarily, a mobile operating system may include some protocol foraccepting and/or responding to queries about mono perspective. Forexample, various rendering utilities, programs, etc. may perform some orall rendering work on behalf of the mobile operating system, and suchentities may require or at least benefit from access to some common monoperspective for rendering content.

By querying the mobile operating system, the stereo controller thus mayutilize the same or a similar mono perspective for mono content, suchthat mono content may appear the same or similar on both the mono andstereo displays. However, other arrangements, including but not limitedto the stereo controller determining a mono perspective internallyand/or independently of the mobile operating system, also may besuitable.

At this point in FIG. 22B the BC branch is shown as splitting intoindividual B and C branches. As noted with regard to FIG. 20B, this isillustrative, and should not be taken as limiting.

In the B branch, the stereo controller defines 2214B a left perspectiverelative to the mono perspective (as queried in step 2214A). In the Cbranch, the stereo controller defines 2214C a right perspective relativeto the mono perspective.

Definition 2214B and 2214C of left and right stereo perspectives maydepend at least in part on the definition 2210 of stereo configuration.For example, if the stereo configuration were defined 2210 as having abaseline of 10 cm, then the left and right stereo perspectives may bedefined 2214B and 2214C such that a distance between base points thereofis likewise 10 cm.

Left and right stereo perspectives may be fixed for a particular stereocontroller and/or a particular stereo head mounted display. However,left and right stereo perspectives also may be variable, and so may bedefined 2214B and 2214C more than once (though for simplicity it isconsidered in FIG. 22A through FIG. 22C that such repetition is notpresent). Variations may include, but are not limited to, changes inangle and changes in base point separation.

Typically though not necessarily, the left and right perspectives willbe offset similarly from the mono perspective, but in oppositedirections. For example, if the left perspective is defined asproceeding from point a 3 centimeters to the left of the monoperspective and angled 1.5 degrees to the right, the right perspectivemay be defined as proceeding from a point 3 centimeters to the right ofthe mono perspective and angled 1.5 degrees to the left. (This is anexample only, and embodiments are not limited thereto with regard eitherto particular perspectives or forms of definition thereof.)

However, other arrangements, including but not limited to an arrangementwherein the left or right perspective is similar or identical to themono perspective, also may be suitable.

In addition, for certain embodiments it may be suitable to determineleft and right perspectives other than through definition explicitly bythe stereo controller. For example, if a system is present within amobile operating system that is adapted to define a perspective (e.g.the mono perspective), that function may be called by the stereocontroller.

Continuing in FIG. 22B, in branch A the mobile operating systemgenerates 2216A a mono surface buffer. Such capability typically may bepresent in a mobile operating system adapted for mono output to a monodisplay, such as flat display on a smart phone. For example, executableinstructions and/or data may be present within the mobile operatingsystem, sufficient to define a region of memory as a mono surface bufferand to address the buffer e.g. by rendering graphical content tosurfaces therein.

In branch B the stereo controller calls 2216B the mobile operatingsystem to generate a left surface buffer, and in branch C the stereocontroller calls 2216C the mobile operating system to generate a rightsurface buffer. That is, in the example of FIG. 22B the stereocontroller communicates with the mobile operating system, and activatessuch functionality in the mobile operating system as may be present forcreating surface buffers, such that two surface buffers are generatedand designated (e.g. by the stereo controller) as left and right surfacebuffers.

Thus, where the mobile operating system itself may be capable of onlysupporting only a mono display, the stereo controller may supportadditional surface buffers sufficient for stereo display. It may beconsidered that the stereo controller in some fashion accesses whateverportion of the mobile operating system generates a mono surface buffer,and that the stereo controller utilizes the mobile operating system tofurther generate left and right surface buffers. The stereo controllermay in some sense re-use or re-purpose existing “machinery” in themobile operating system, so as to produce a function—the output ofstereo and/or mixed mono/stereo content—that may be beyond the reach of(and that may never even have been contemplated for) the mobileoperating system itself.

Embodiments are not limited with regard to how the surface buffergeneration functions of the mobile operating system may be called by thestereo controller. The term “call” refers to communication between thestereo controller and the mobile operating system, so as to accessfunctions present within the mobile operating system, but this mayinclude a broad range of approaches in various embodiments.

Typically, though not necessarily, such approaches may in some mannerre-purpose existing capabilities of the mobile operating system. Thatis, if the mobile operating system has the capability to create a monosurface buffer, then the stereo controller may activate that capability,causing the mobile operating system to create a surface buffer, but withthe stereo controller having set aside memory space for that surfacebuffer, identifying that surface buffer as a left (or right) stereosurface buffer, subsequently addressing left or right stereo rendersthereto, etc. Put differently, the stereo controller may in at leastsome embodiments rely on the ability of the mobile operating system tocreate a mono surface buffer, but may re-purpose that surface buffer fordelivering stereo output.

One example of such an approach may be to “spoof” the mobile operatingsystem, such that the mobile operating system considers that additionaldisplays are present in addition to the integral mono display of thesmart phone (e.g. defining “virtual” displays and advising the mobileoperating system of the presence of such virtual displays as if thevirtual displays were real/physical displays). As noted, certain mobileoperating systems may include therein functionality for creating asurface buffer. In addition, certain mobile operating systems mayinclude command paths, protocols, etc. for external agents to cause themobile operating system to create a surface buffer. For example,although the integral mono display of a smart phone may indeed be partof the smart phone itself, in strict terms that mono display may be anexternal device insofar as the mobile operating system is concerned, inthat the mobile operating system is instantiated on the processor andthe mono display is external thereto. Thus some arrangement may beprovided within the mobile operating system such that if a display isplaced in communication therewith, the mobile operating system may thenrecognize and create surface buffers (and perform other functions) forthat display.

Thus, command pathways, protocols, etc. may be readily available for theuse of the stereo controller. In such instance the stereo controller mayidentify the presence of two additional displays, and request thatsurface buffers be created to support those additional displays. Thoseadditional displays may be real left and right stereo displays (e.g. onthe head mounted display referenced for the example of FIG. 22A throughFIG. 22C), but may also be virtual displays, for example existing onlyas data constructs.

Alternately, a command path and/or protocol may be present in the mobileoperating system for prompting the generation of surface buffers withoutnecessarily indicating the presence of additional displays (real orvirtual). As another alternative, if no convenient avenue for calling2216B and 2216C the mobile operating system to generate additionalsurface buffers is present within the mobile operating system, thestereo controller instead may directly activate whatever executableinstructions in the mobile operating system are adapted to generatesurface buffers. As yet another alternative, executable instructions forgenerating surface buffers in the mobile operating system may be copiedby the stereo controller, and then executed to generate left and rightsurface buffers.

Other arrangements also may be equally suitable.

It is noted that although the mobile operating system may be carryingout the direct work of generating the left and right surface buffers,that generation is called 2216B and 2216C and overseen by the stereocontroller. Typically a mobile operating system dedicated to monodisplay may lack provision for handling such additional (e.g. left andright) surface buffers as may be utilized for stereo display. Thus, thestereo controller may set aside memory for the left and right surfacebuffers, may identify surface buffers as left and right surface buffers,etc. The mobile operating system may not even be “aware” of the creationof the left and right surface buffers, despite carrying out the actualgeneration thereof.

Other embodiments wherein the stereo controller directly generates leftand right surface buffers are not prohibited. However, in calling 2216Band 2216C the mobile operating system to generate left and right surfacebuffers, it is not necessary for the stereo controller to includeexecutable instructions for generating left and right surface buffers.In more colloquial terms, if the mobile operating system already has thecode to produce surface buffers, then there may be no need to duplicatesuch functions in the stereo controller.

In addition, if the mobile operating system is called 2216B and 2216C togenerate the left and right surface buffers, then it may be anticipatedwith at least reasonable confidence that the left and right surfacebuffers will correspond with the mono surface buffer in terms of format,data protocols, etc. Consistency among mono, left, and right buffersthus may be facilitated, which in turn may facilitate similar-appearingoutput from both the mono display (on the smart phone) and the stereodisplay (on the head mounted display).

However, these are examples only, and other arrangements may be equallysuitable. Any function that may be accomplished through calling themobile operating system may be permitted to be accomplished by callingthe mobile operating system, regardless of whether such a function iscalled in FIG. 22A through FIG. 22C (or elsewhere herein). Thus,determining left and right perspectives, outputting left and rightimages, etc. may in certain embodiments by carried out through calling amobile operating system (or other mono controller) rather thannecessarily being carried out more directly by the stereo controller.Conversely, any function that may be accomplished directly by the stereocontroller rather than by calling the mono controller also may bepermitted to be accomplished directly by the stereo controller.Embodiments are not limited in this regard, unless specifically notedherein.

Still with reference to FIG. 22B, in the A branch the mobile operatingsystem generates 2218A a mono image buffer. In the B branch the stereocontroller calls 2218B the mobile operating system to generate a leftimage buffer. In the C branch the stereo controller calls 2218C themobile operating system to generate a right image buffer.

As noted with regard to the generation of surface buffers above,functionality may already be present within the mobile operating systemto generate a suitable image buffer. However, the mobile operatingsystem typically may be unsuited to and/or incapable of supportingadditional image buffers. Rather, the stereo controller may makeprovision for left and right image buffers, but may rely on any existingfunctionality for actually generating the image buffers as may bepresent within the mobile operating system.

Similarly to calling 2216B and 2216C generation of left and rightsurface buffers described above, calling 2218B and 2218C generation ofimage buffers may be carried out in a variety of manners for variousembodiments. For example, the mobile operating system may be informed(correctly or not) of the presence of additional displays by the stereocontroller; the mobile operating system may be commanded to generateimage buffers by the stereo controller without necessarily indicatingthe presence of displays; the executable instructions in the mobileoperating system responsible for generating image buffers may beactivated directly by the stereo controller; the executable instructionsin the mobile operating system responsible for generating image buffersmay be copied; etc.

Also similarly, calling 2218B and 2218C the mobile operating system togenerate image buffers may exhibit advantages. For example, the stereocontroller may be freed from duplicating already-existing functionswithin the mobile operating system, consistency of the image buffersand/or displayed content may be facilitated, etc.

However, again, it is not prohibited for other embodiments to generateimage buffers directly with the stereo controller and/or other entities,without recourse to the mobile operating system (or other monocontroller), and other arrangements may be suitable.

Continuing in FIG. 22B, in the A branch the mobile operating systemrenders 2220A a mono surface for each graphics feed, from the monoperspective. In the B branch the stereo controller calls 2220B1 themobile operating system to render a left surface for each 2D graphicsfeed, from a mono perspective. In the C branch the stereo controllercalls 2220C1 the mobile operating system to render a right surface foreach 2D graphics feed, from a mono perspective.

As noted above with regard to certain other steps in FIG. 22A throughFIG. 22C, functionality may already be present within the mobileoperating system to render surfaces from some perspective, although themobile operating system typically may be unsuited to and/or incapable ofaddressing multiple surface buffers, etc. The stereo controller may makeprovision for addressing renders to left and right surface buffers, butmay rely partly or entirely on existing functionality for actuallyrendering surfaces as may be present within the mobile operating system.

Similarly certain other steps in FIG. 22A through FIG. 22C, calling2220B 1 and 2220C1 the mobile operating system to render to surfaces maybe carried out in a variety of manners for various embodiments, by“spoofing” the mobile operating system, by calling rendering routines,by commanding the execution of particular instructions, by copyingexecutable instructions, etc.

In addition, although for simplicity FIG. 22B refers to rendering asbeing carried out by the mobile operating system, in practice it alsomay be acceptable for the mobile operating system to in turn call otherentities, for example calling a rendering engine that may not beconsidered part of the mobile operating system proper, etc. Similar“extended calling” and other use of additional entities and/or resourcesis not prohibited for rendering, nor for other steps herein, unlessspecifically noted.

Also similarly to certain previous steps, calling 2220B1 and 2220C1 themobile operating system to render graphics feeds to left and rightsurfaces may exhibit advantages over (for example) rendering graphicsfeeds to surfaces directly by the stereo controller. For example,duplication of effort, consistency may be facilitated, etc. However italso is not prohibited for the stereo controller to render surfacesdirectly.

Now with reference to FIG. 2C, in the B branch the stereo controllercalls 2220B2 the mobile operating system to render a left surface foreach 3D graphics feed, from a left perspective. In the C branch thestereo controller calls 2220C2 the mobile operating system to render aright surface for each 3D graphics feed, from a right perspective.

As noted above, functionality may already be present within the mobileoperating system to render surfaces from some perspective, although themobile operating system typically may be unsuited to and/or incapable ofaddressing multiple surface buffers, addressing multiple perspectives(e.g. left and right), etc. The stereo controller may make provision foraddressing renders to left and right surface buffers, for advising themobile operating system as to the perspectives (left and right) forrendering, etc., but may rely partly or entirely on existingfunctionality for actually rendering surfaces as may be present withinthe mobile operating system.

Similarly to certain other steps in FIG. 22A through FIG. 22C, calling2220B2 and 2220C2 the mobile operating system to render to surfaces maybe carried out in a variety of manners for various embodiments, by“spoofing” the mobile operating system, by calling rendering routines,by commanding the execution of particular instructions, by copyingexecutable instructions, etc.

It is also noted in various embodiments, 3D content may for example berendered as 2D content. Thus, some or all of a graphics feed thatincludes 3D content may instead be rendered in 2D, e.g. as monosurfaces. Although for simplicity the arrangement in FIG. 22A throughFIG. 22C refers to graphics feeds as being either 2D or 3D, and beingrendered on that basis, embodiments are not necessarily limited to suchstrictly-defined arrangements.

Also similarly to certain previous steps, calling 2220B2 and 2220C2 themobile operating system to render graphics feeds to left and rightsurfaces may exhibit advantages over (for example) rendering graphicsfeeds to surfaces directly by the stereo controller. For example,duplication of effort, consistency may be facilitated, etc. However italso is not prohibited for the stereo controller to render surfacesdirectly.

Continuing in FIG. 22C, in the A branch the mobile operating systemcomposites 2222A the mono surfaces in the mono surface buffer. In the Bbranch the stereo controller calls 2222B the mobile operating system tocomposite the left surfaces in the left surface buffer. In the C branchthe stereo controller calls 2222C the mobile operating system tocomposite the right surfaces in the right surface buffer.

As noted with regard to other steps in FIG. 22A through FIG. 22C,functionality may already be present within the mobile operating systemto composite surfaces, although the mobile operating system typicallymay be unsuited to and/or incapable of addressing multiple surfacebuffers for compositing. For example, the mobile operating system mayalready be adapted to rearrange surfaces in a mono surface buffer, toreposition surfaces with respect to one another, etc., but may have noprovision for retaining multiple buffers in memory, addressing and/orsynchronizing compositing for multiple buffers, etc. Rather, the stereocontroller may make provision for addressing the left and right surfacebuffers for compositing, but may rely partly or entirely on existingfunctionality in the mobile operating system for actual compositing.

The stereo controller also may, but is not required to, supportadditional functions, for example synchronizing compositing for mono,left, and right surface buffers such that surfaces have similar ordersin the mono, left, and right surface buffers once composited, thatsurfaces in the mono, left, and right surface buffers are spatiallyarranged in similar manner, etc.

Similarly to certain other steps in FIG. 22A through FIG. 22C, calling2222B and 2222C the mobile operating system to composite surfaces may becarried out in a variety of manners for various embodiments, by“spoofing” the mobile operating system, by calling compositing routines,by commanding the execution of particular instructions, by copyingexecutable instructions, etc.

Also similarly to certain previous steps, calling 2222B and 2222C themobile operating system to composite left and right surfaces may exhibitadvantages over (for example) compositing left and right surfacesdirectly by the stereo controller. For example, duplication of effortmay be avoided, consistency may be facilitated, etc. However it also isnot prohibited for the stereo controller to composite surfaces directly.

Still with reference to FIG. 22C, in the A branch the mobile operatingsystem merges 2224A the mono surfaces into a mono image in the monoimage buffer. In the B branch the stereo controller calls 2224B themobile operating system to merge the left surfaces into a left image inthe left image buffer. In the C branch the stereo controller calls 2224Cthe mobile operating system to merge the right surfaces into a rightimage in the right image buffer.

Again as noted with regard to other steps, functionality may already bepresent within the mobile operating system to merge surfaces into animage, although the mobile operating system typically may be unsuited toand/or incapable of addressing multiple surface buffers and/or imagebuffers for merging. The stereo controller may make provision foraddressing the left and right surface buffers and/or left and rightimage buffers for merging, but may rely partly or entirely on existingmerge functionality in the mobile operating system.

Similarly to certain other steps, calling 2224B and 2224C the mobileoperating system to merge surfaces may be carried out in a variety ofmanners for various embodiments, by “spoofing” the mobile operatingsystem, by calling merging routines, by commanding the execution ofparticular instructions, by copying executable instructions, etc.

Also similarly to certain previous steps, calling 2224B and 2224C themobile operating system to merge left and right surfaces may exhibitadvantages over (for example) merging left and right surfaces directlyby the stereo controller. For example, duplication of effort may beavoided, consistency may be facilitated, etc. However it also is notprohibited for the stereo controller to composite surfaces directly.

Continuing in FIG. 22C, in the A branch the mobile operating systemoutputs 2226A the mono image from the mono image buffer to the integralmono display of the smart phone. In the B branch the stereo controlleroutputs 2226B the left image from the left image buffer to the leftdisplay of the stereo head mounted display. In the C branch the stereocontroller outputs 2226C the left image from the left image buffer tothe left display of the stereo head mounted display.

Functionality may already be present within the mobile operating systemto output a mono image to the mono display. The stereo controller thusmay include functionality to output left and right images to left andright displays, respectively. However, although the arrangement in FIG.22C indicates that the stereo controller directly outputs left and rightimages to left and right displays, other arrangements may be equallysuitable, including but not limited to calling the mobile operatingsystem to output left and right images to left and right displays.

Now with reference to FIG. 23, therein is shown an example embodiment ofan apparatus 2360 for stereo and/or mixed mono/stereo output, inschematic form. As shown, the apparatus 2360 includes a processor 2366,adapted to execute executable instructions instantiated thereon. Theprocessor 2366 is not limited with regard to form, structure, etc. Theprocessor 2366 may for example be a digital electronic processor, suchas may be present in a smart phone, tablet, laptop computer, desktopcomputer, etc., but other arrangements also may be suitable.

The apparatus 2360 also includes a mono display 2365, and left and rightstereo displays 2364-L and 2364-R; although identified separately inFIG. 23, the pair 2364-L and 2364-R may be considered, in at least somesense, to form a single display. The mono display 2365 is adapted todeliver graphical output in mono form, and the left and right stereodisplays 2364-L and 2364-R are adapted to deliver graphical output inmono forma and/or in stereo form. Embodiments are not limited withregard to the form, structure, etc. of the mono display 2365 and/or thestereo display 2364-L and 2364-R. For example, the displays 2365,2364-L, and 2364-R may include LED or OLED displays, CRT displays,plasma displays, laser displays, etc., though other arrangements may beequally suitable.

In addition, the example apparatus 2360 as-illustrated also includes adata store 2372, a communicator 2374, and left and right sensors 2376-Land 2376-R. The data store 2372, communicator 2374, and left and rightsensors 2376-L and 2376-R may serve for example as sources of graphicalcontent, e.g. images, video, text, icons, etc. may be read from the datastore 2372, received via the communicator 2374, captured with the leftand right sensors 2376-L and 2376-R, etc. However, other graphicalcontent sources may be equally suitable; a data store 2372, communicator2374, and/or left and right sensors 2376-L and 2376-R are notnecessarily required for all embodiments, nor are the data store 2372,communicator 2374, and left and right sensors 2376-L and 2376-Rnecessarily limited only to operating as graphical content sources.

In addition, where such features are present embodiments are not limitedwith regard to the form, structure, etc. of a data store 2372, acommunicator 2374, and/or left and right sensors 2376-L and 2376-R. Adata store 2372 may for example include a hard drive, flash memory, etc.A communicator 2374 may include a hardwired connection, wireless modem,etc. Left and/or right sensors 2376-L and 2376-R may include digital oranalog cameras, depth cameras, depth sensors, etc. Other arrangementsalso may be equally suitable.

Still with reference to FIG. 23, as may be seen data entities 2368 and2370 are shown disposed on the processor 2366, namely a mono controller2368 and a stereo controller 2370. The mono controller 2368 and stereocontroller 2370 may include executable instructions instantiated on theprocessor, non-executable data, some combination thereof, etc. Withregard to the example shown in FIG. 23 the mono controller 2369 andstereo controller 2370 are described as including executableinstructions, but other arrangements may be equally suitable.

The mono controller 2368 is shown as further including therein a numberof data entities 2368-A through 2368-I. Likewise, the stereo controller2370 is shown as further including therein a number of data entities2370-A through 2370-I. Although as illustrated the data entities 2368-Athrough 2368-I and 2370-A through 2370-I are shown as being disposedwithin and/or components of larger data entities, i.e. the monocontroller 2368 and stereo controller 2370 respectively, this isillustrative only. Embodiments are not limited with regard to theorganization and/or structure of the mono controller 2368 and stereocontroller 2370, nor with regard to elements thereof. For example incertain embodiments data entities 2370-A through 2370-I may beindependent data entities, e.g. separate programs, with the stereocontroller 2370 being only a collective term applied thereto rather thanan integrated data entity or other structure in itself. Likewise, dataentities as shown in FIG. 23 may be combined, further split, etc. invarious embodiments, so long as suitable functions are carried out. Inaddition, data entities may be added to and/or deleted from what isshown in FIG. 23. For example, for an embodiment wherein the presence ofa mono display may be assumed, the mono display detector 2368-B may beomitted. Conversely, though the mono surface renderer 2368-F is shown asa single data entity, embodiments may include multiple renderingelements, such as rendering engines, libraries, other resources, etc.Moreover, entities referenced but not explicitly illustrated may bepresent; for example, a mono surface buffer, e.g. as established by themono surface buffer establisher 23368-D, may be part of and/orconsidered with the mono controller 2368, for example being assignedmemory space within the memory controller/occupied by the monocontroller 2368 itself (though such is not required).

With regard individually to the data entities 2368-A through 2368-I inthe mono controller 2368 in FIG. 23, a graphical content communicator2368-A is disposed on the processor 2366; the graphical contentcommunicator 2368-A is adapted to communicate with graphical contentsources, for example so as to send requests and/or instructions thereto,to receive graphical content therefrom, to query regarding the form orstatus of graphical content, etc. A mono display detector 2368-B isdisposed on the processor 2366; the mono display detector 2368-B isadapted to detect the presence of one or more mono displays incommunication with the mono controller 2368, the processor 2366, theapparatus 2360 as a whole, etc. The mono display detector 2368-B alsomay determine additional information regarding mono displays as may bepresent, such as display resolution, color bit depth, dimensions, etc.,though this is not required.

A mono perspective establisher 2368-C is disposed on the processor 2366;the mono perspective establisher 2368-C is adapted to define orotherwise establish one or more mono perspectives for graphical content,e.g. so as to facilitate rendering of graphical content from a monoperspective. A mono surface buffer establisher 2368-D is disposed on theprocessor 2366; the mono surface buffer establisher 2368-D is adapted toassign memory for, define, and/or otherwise establish a surface bufferadapted to receive one or more renders onto surfaces thereof, e.g.renders from a mono perspective. A mono image buffer establisher 2368-Eis disposed on the processor 2366; the mono image buffer establisher2368-E is adapted to assign memory for, define, and/or otherwiseestablish an image buffer adapted to receive one or more images therein.

A mono surface renderer 2368-F is disposed on the processor 2366; themono surface renderer 2368-F is adapted to render graphical content,e.g. from a mono perspective, onto surfaces such as may be presentwithin a surface buffer. A mono surface compositor 2368-G is disposed onthe processor 2366; the mono surface compositor 2368-G is adapted tocomposite surfaces such as may be present in a mono surface buffer, forexample ordering surfaces, realigning surfaces, scaling surfaces, etc. Amono image merger 2368-H is disposed on the processor 2366; the monoimage merger 2368-H is adapted to merge one or more surfaces, such asmay be present in a mono surface buffer, into an image, and/or todeliver such an image to a mono image buffer.

A mono outputter 2368-I is disposed on the processor 2366; the monooutputter 2368-I is adapted to output an image, such as may be presentin a mono image buffer, to a mono display 2365.

With regard individually to the data entities 2370-A through 2370-I inthe stereo controller 2370 in FIG. 23, a mono controller communicator2370-A is disposed on the processor 2366; the mono controllercommunicator 2370-A is adapted to communicate with a mono controller2368, for example to receive graphical content therefrom, to sendcommands and/or queries thereto, etc. The mono controller communicator2370-A also may be adapted to determine a dimensionality of graphicalcontent, e.g. by querying the graphical content communicator 2368-A inthe mono controller 2368. In certain embodiments the mono controllercommunicator 2370-A may be adapted to address the mono controller 2368in a manner other than may be typical for the operation of the monocontroller 2368, for example the mono controller communicator 2370-A maybe adapted to “spoof” the mono controller 2368 by sending spuriousinstructions thereto, calling or otherwise accessing functions withinthe mono controller 2368 not normally available to external entities,etc.

It is emphasized that the configuration for the processor 2366, the monocontroller 2368, and the stereo controller 2370 as shown in FIG. 23 isan example only. As shown, the mono controller 2368 and the stereocontroller 2370 are both disposed on the same processor 2366, monocontroller 2368 and the stereo controller 2370 are distinct from oneanother, and mono controller 2368 and the stereo controller 2370 eachintegrate all of their respective elements. However, none of thesearrangements are required (and certain alternatives, though notnecessarily the only alternatives, are shown elsewhere herein).

For example, in certain embodiments the mono controller 2368 and thestereo controller 2370 may themselves be integrated, e.g. as part of asingle piece of software. As a more concrete example, an existing monocontroller 2368 such as Android or another a mobile operating system maybe modified, so as to include some or all functions and/or elements of astereo controller 2370. In such instance, if the stereo controller 2370were to call the mono controller 2368, the mono controller may in factonly be calling other instructions within a single program, rather thancalling another program. Given such an arrangement, it may not benecessary or useful to “spoof” or otherwise access functions in the monocontroller 2368 that are not normally available to external entities,since in such an arrangement the stereo controller 2370 may not in factbe an external entity but rather part of the same operating system,program, etc.

Similarly, the mono controller 2368 and the stereo controller 2370 maybe broken down into segments, spread across multiple processors,distributed throughout a cloud, etc. Although the mono controller 2368and the stereo controller 2370 are described in at least some instancesherein as clearly distinct entities for clarity in explaining certainfunctions thereof, embodiments are not so limited, nor are embodimentslimited only to the arrangements shown and described herein.

Still with reference to FIG. 23, a stereo display detector 2370-B isdisposed on the processor 2366; the stereo display detector 2370-B isadapted to detect the presence of one or more stereo displays incommunication with the stereo controller 2370, the processor 2366, theapparatus 2360 as a whole, etc. The stereo display detector 2370-B mayestablish a stereo configuration, e.g. at least in part throughcommunicating with the stereo display so as to determine features suchas display resolution, color bit depth, dimensions, spacing between leftand right displays (or otherwise establishing stereo configuration),etc., and/or through reading settings therefrom and/or to be appliedthereto such as degree of overlap of left and right stereo fields ofview, etc.

A perspective caller 2370-C is disposed on the processor 2366; theperspective caller 2370-C is adapted to call the mono controller 2368,e.g. the mono perspective establisher 2368-C in particular, to define orotherwise establish one or more pairs of left and right stereoperspectives for graphical content, for example so as to facilitaterendering of graphical content from a mono perspective. The perspectivecaller 2370-C may also be adapted to provide additional information,oversight, control, etc. as needed to an extent that the mono controller2368 may not be sufficient to establish left and right stereoperspectives. Thus, in the arrangement of FIG. 23 the perspective caller2370-C may call upon an existing ability of the mono controller 2368 todefine perspectives, repurposing that ability so as to accomplish thedefinition of left and right stereo perspectives (which task the monocontroller on its own may be insufficient to carry out).

A surface buffer caller 2370-D is disposed on the processor 2366; thesurface buffer caller 2370-D is adapted to call the mono controller2368, e.g. the mono surface buffer establisher 2368-D in particular, todefine or otherwise establish left and right surface buffers adapted toreceive one or more left and right renders respectively onto surfacesthereof, e.g. renders from left and right perspectives. The surfacebuffer caller 2370-D may also be adapted to provide additionalinformation, oversight, control, etc. as needed to an extent that themono controller 2368 may not be sufficient to establish left and rightsurface buffers. Thus, in the arrangement of FIG. 23 the surface buffercaller 2370-D may call upon an existing ability of the mono controller2368 to create surface buffers, repurposing that ability so as toaccomplish the creation of left and right stereo surface buffers (whichtask the mono controller on its own may be insufficient to carry out).

An image buffer caller 2370-E is disposed on the processor 2366; theimage buffer caller 2370-E is adapted to call the mono controller 2368,e.g. the mono image buffer establisher 2368-E in particular, to defineor otherwise establish left and right image buffers adapted to receiveone or more left and right images respectively therein, e.g. merged fromleft and right surfaces. The image buffer caller 2370-E may also beadapted to provide additional information, oversight, control, etc. asneeded to an extent that the mono controller 2368 may not be sufficientto establish left and right image buffers. Thus, in the arrangement ofFIG. 23 the image buffer caller 2370-E may call upon an existing abilityof the mono controller 2368 to create image buffers, repurposing thatability so as to accomplish the creation of left and right stereo imagebuffers (which task the mono controller on its own may be insufficientto carry out).

A surface renderer caller 2370-F is disposed on the processor 2366; thesurface renderer caller 2370-F is adapted to call the mono controller2368, e.g. the mono surface renderer 2368-F in particular, to rendergraphical content from left and right perspectives into left and rightsurfaces respectively. The surface renderer caller 2370-F may also beadapted to provide additional information, oversight, control, etc. asneeded to an extent that the mono controller 2368 may not be sufficientto render from multiple perspectives (e.g. left and right stereoperspectives), address multiple surface buffers, etc. Thus, in thearrangement of FIG. 23 the surface renderer caller 2370-F may call uponan existing ability of the mono controller 2368 to render graphicalcontent to surfaces, repurposing that ability so as to accomplish therendering of graphical content to left and right surfaces respectively(which task the mono controller on its own may be insufficient to carryout).

A surface compositor caller 2370-G is disposed on the processor 2366;the surface compositor caller 2370-G is adapted to call the monocontroller 2368, e.g. the mono surface compositor 2368-G in particular,to composite left and right surfaces. The surface compositor caller2370-G may also be adapted to provide additional information, oversight,control, etc. as needed to an extent that the mono controller 2368 maynot be sufficient to address multiple groups of surfaces (e.g. left andright stereo surfaces), etc. Thus, in the arrangement of FIG. 23 thesurface compositor caller 2370-G may call upon an existing ability ofthe mono controller 2368 to composite surfaces, repurposing that abilityso as to accomplish the compositing of left and right surfaces (whichtask the mono controller on its own may be insufficient to carry out).

An image merger caller 2370-H is disposed on the processor 2366; theimage merger caller 2370-H is adapted to call the mono controller 2368,e.g. the mono image merger 2368-H in particular, to merge left and rightsurfaces. The image merger caller 2370-H may also be adapted to provideadditional information, oversight, control, etc. as needed to an extentthat the mono controller 2368 may not be sufficient to merge multiplegroups of surfaces into images (e.g. left and right stereo surfaces intoleft and right images respectively), etc. Thus, in the arrangement ofFIG. 23 the image merger caller 2370-H may call upon an existing abilityof the mono controller 2368 to merge surfaces into images in an imagebuffer, repurposing that ability so as to accomplish the merging of leftand right surfaces into left and right images in left and right imagebuffers respectively (which task the mono controller on its own may beinsufficient to carry out).

A stereo outputter 2370-I is disposed on the processor 2366; the stereooutputter 2370-I is adapted to output left and right images, such as maybe present in left and right stereo image buffers respectively, to astereo display such as left and right stereo displays 2364-L and 2364-R.

It is emphasized that the arrangement in FIG. 23 is an example only, andthat many variations may be possible for various embodiments. Certainvariations, though not necessarily the only suitable variations, areshown and described with regard to FIG. 24 through FIG. 27.

Now with reference to FIG. 24, therein is shown another exampleembodiment of an apparatus 2460 for stereo and/or mixed mono/stereooutput, in schematic form. Where the example in FIG. 23 showed anintegrated apparatus 2360, the apparatus 2460 in FIG. 24 includes twodistinct units, a mono device 2461 and a stereo device 2462. Forexample, such an arrangement may reflect an embodiment wherein a mobiledevice such as a smart phone hosts a mono controller 2468 thereon, whilea physically separate device such as a stereo head mounted display hostsa stereo controller 2470 thereon. Embodiments are not limited withregard to whether an apparatus 2460 includes multiple physical (and/orlogical) divisions such as the mono device 2461 and stereo device 2462of FIG. 24, or is integrated as the apparatus 2360 in FIG. 23, nor withregard to the particulars of such divisions (if any).

In the example of FIG. 24, the mono device 2461 includes a processor2467, along with a mono display 2465, a data store 2473, and acommunicator 2475 in communication with the processor 2467. Although asnoted with regard to FIG. 23, the communicator 2475 may be adapted toserve as a graphical content source, as shown in the example of FIG. 24the communicator 2475 may serve to communicate otherwise, e.g. thecommunicator 2475 in the mono device 2461 may communicate with thecommunicator 2474 in the stereo device 2462, such that processors 2466and 2467 are in communication, etc., though this may not be required forall embodiments.

As may be seen, the mono controller 2468 includes a graphical contentcommunicator 2468-A, a mono display detector 2468-B, a mono perspectiveestablisher 2468-C, a mono surface buffer establisher 2468-D, a monoimage buffer establisher 2468-E, a mono surface renderer 2468-F, a monosurface compositor 2468-G, a mono image renderer 2468-H, and a monooutputter 2468-I. Similar data entities were described with regard toFIG. 23, although as noted embodiments are not necessarily limited onlythereto.

The stereo controller 2470 includes a mono controller communicator2470-A, a stereo display detector 2470-B, and a stereo outputter 2470-I;similar entities were described with regard to FIG. 23, although asnoted embodiments are not necessarily limited only thereto.

In addition, the stereo controller 2470 as shown in FIG. 24 includesdata entities 2470-C through 2470-H; although data entities 2470-Cthrough 2470-H may in some sense be analogous to data entities alreadydescribed with regard to FIG. 23, certain differences are now noted.

The stereo perspective establisher 2470-C in FIG. 24 is adapted todefine or otherwise establish one or more left and right stereoperspectives for graphical content, e.g. so as to facilitate renderingof graphical content from left and right stereo perspectives. Where inFIG. 23 existing perspective establishment capabilities of the monocontroller 2368 therein were called by the stereo controller 2370therein, in the arrangement of FIG. 24 the stereo controller 2470 itselfis adapted to establish suitable left and right perspectives.

Similar distinctions are drawn with regard to data entities 2470-Dthrough 2470-H. A stereo surface buffer establisher 2470-D is disposedon the processor 2466; the stereo surface buffer establisher 2470-D isadapted to assign memory for, define, and/or otherwise establish leftand right buffers adapted to receive one or more renders onto surfacesthereof, e.g. renders from left and right stereo perspectives. A stereoimage buffer establisher 2470-E is disposed on the processor 2466; thestereo image buffer establisher 2470-E is adapted to assign memory for,define, and/or otherwise establish left and right image buffers adaptedto receive one or more left and right images therein. A stereo surfacerenderer 2470-F is disposed on the processor 2466; the stereo surfacerenderer 2470-F is adapted to render graphical content, e.g. from leftand right stereo perspectives, onto left and right surfaces such as maybe present within left and right surface buffers, respectively. A stereosurface compositor 2470-G is disposed on the processor 2466; the stereosurface compositor 2470-G is adapted to composite left and rightsurfaces such as may be present in left and right surface buffers, forexample ordering surfaces, realigning surfaces, scaling surfaces, etc. Astereo image merger 2470-H is disposed on the processor 2466; the stereoimage merger 2470-H is adapted to merge one or more left and rightsurfaces, such as may be present in left and right surface buffers, intoleft and right images respectively, and/or to deliver such left andright images to a left and right image buffers.

Embodiments are not limited with regard to which function(s) are calledin a mono controller by a stereo controller, and/or are performed by thestereo controller itself. Other arrangements, wherein some functions arecalled by the stereo controller and some performed natively by thestereo controller, may be equally suitable.

Now with reference to FIG. 25, therein is shown another exampleembodiment of an apparatus 2560 for stereo and/or mixed mono/stereooutput, in schematic form. The example in FIG. 24 showed an apparatus2460 with distinct stereo and mono devices 2462 and 2463, with the monodevice 2463 including a mono display 2465. The example in FIG. 24 alsoshows a non-specific mono controller 2468, and communicators 2475 and2474 in both mono and stereo devices 2463 and 2462, respectively.

By contrast, in the arrangement of FIG. 25 a stereo device 2562 ispresent and distinct, but no mono device is present. Rather, a supportdevice 2563 is illustrated, including a processor 2567 and a data store2573 but lacking a mono display. Where the mono device 2463 of FIG. 24may represent a device including a mono display such as a smart phone,tablet, etc., the support device 2563 of FIG. 25 may represent a devicewith processing capability but without necessarily including a display(mono or otherwise). Such a support device 2563 may be a portableprocessor, a “wallet” computer (e.g. an electronic device adapted toprovide processing power and to be conveniently carried in a pocket,purse, etc. so as to support other electronic systems), etc., thoughother arrangements may be suitable.

In addition, the processor 2567 in the support device 2563 is shown witha mobile operating system 2568 disposed thereon. Certain mobileoperating systems may serve as, and/or support functions similar to,those described with regard to mono controllers as previously referencedherein. The mobile operating system 2568 as illustrated includes anumber of data entities 2568-A through 2568-I, namely a graphicalcontent communicator 2568-A, a mono display detector 2468-B, a monoperspective establisher 2568-C, a mono surface buffer establisher2568-D, a mono image buffer establisher 2568-E, a mono surface renderer2568-F, a mono surface compositor 2568-G, a mono image merger 2568-H,and a mono outputter 2568-I. Similar data entities were described withregard to FIG. 23, although as noted embodiments are not necessarilylimited only thereto.

Further, in the arrangement of FIG. 25 no distinct communicators areshown therein. Rather, the support device 2563 and stereo device 2562are shown with a communications link therebetween. Such an arrangementmay implicitly include one or more communicators, may replacecommunicators (e.g. as a simple “hard wire” link rather than awell-defined hardware and/or software communication entity), etc.

It is noted that absent a mono display, some or all data entities 2568-Athrough 2568-I may not function as designed. For example, the monooutputter 2568-I may not be able to output mono content to a monodisplay if no such mono display exists. Similarly, if mono contentcannot be (or at least is not) outputted to a mono display, then thevarious data entities contributing to producing that mono content maynot perform, and/or may be unable to perform, original functions forwhich those data entities were configured, i.e. mono output to a monodisplay.

It is noted that the inability of certain data elements to performoriginally configured functions is not prohibited, nor does the presenceof such data elements necessarily interfere with the operation ofvarious embodiments. In more colloquial terms, lack of a mono displaydoes not necessarily cause malfunctions even if mono output is nominallysupported, and thus data entities addressing mono output need notnecessarily be removed if present. For example, for the mobile operatingsystem 2568 as shown in FIG. 25, it may not be necessary to delete,inactivate, suspend function of, etc. data entities and/or capabilitiestherein merely because those data entities and/or capabilities are notperforming the functions for which those data entities were originallyconfigured (although deleting, inactivating, suspending functions, etc.also is not prohibited). Thus, in at least certain embodiments a mobileoperating system may be used “stock”, or without necessarily requiringmodification, when delivering stereo and/or mixed mono/stereo content(even if the mobile operating system were in itself adapted solely todeliver mono content only, to a mono display only).

It is also noted that even if certain of data entities 2568-A through2568-I may not perform functions as originally configured, for at leastcertain embodiments some or all such data entities 2568-A through 2568-Imay perform other functions. For example, functions in the mobileoperating system 2568 configured for mono-only output to a mono-onlydisplay may be called by the stereo controller 2570, the stereocontroller 2570 thus repurposing existing portions of the mobileoperating system to perform functions (e.g. stereo and/or mixedmono/stereo output) that the mobile operating system in itself does notperform.

Notably, the stereo controller 2570 as illustrated includes a number ofdata entities 2570-A through 2570-I, namely a mobile operating systemcommunicator 2570-A, a stereo display detector 2470-B, a perspectivecaller 2570-C, a surface buffer caller 2570-D, an image buffer caller2570-E, a surface renderer caller 2570-F, a surface compositor caller2570-G, an image merger caller 2570-H, and a stereo outputter 2570-I.

The mobile operating system communicator 2570-A is disposed on theprocessor 2566 of the stereo device 2562; the mobile operating systemcommunicator 2570-A is adapted to communicate with a mobile operatingsystem 2568, for example to receive graphical content therefrom, to sendcommands and/or queries thereto, etc. In certain embodiments the mobileoperating system communicator 2570-A may be adapted to address themobile operating system 2568 in a manner other than may be typical forthe operation of the mobile operating system 2568, for example themobile operating system communicator 2570-A may be adapted to “spoof”the mobile operating system 2568 by sending spurious instructionsthereto, calling or otherwise accessing functions within the mobileoperating system 2568 not normally available to external entities, etc.The mobile operating system communicator 2570-A may be at least somewhatanalogous to the mono controller communicator 2370-A in FIG. 23. Similardata entities to 2570-B through 2570-I also were described with regardto FIG. 23, although as noted embodiments are not necessarily limitedonly thereto.

Turning now to FIG. 26, therein is shown another example embodiment ofan apparatus 2660 for stereo and/or mixed mono/stereo output, inschematic form. The apparatus 2660 includes a support device 2663 and astereo device 2662. However, where in certain previous examples eachsuch device has been shown with a processor therein, in the arrangementof FIG. 26 only the support device has a processor 2667 therein, with amono controller 2668 and stereo controller 2670 disposed therein. Thesupport device 2663 also includes a data store 2673 in communicationwith the processor 2667.

By contrast, the stereo device 2662 is shown to include only left andright stereo displays 2664-L and 2664-R and left and right sensors2676-L and 2676-R. Embodiments are not limited with regard to whatelement(s) may be present in what device(s) (for arrangements whereinthe apparatus includes two or more devices). In particular, it is notedwith reference to FIG. 26 that a given device, as shown the stereodevice 2662, may include relatively few, or even only one, functionalelement of the apparatus 2660. For example, in the arrangement shown inFIG. 26 the stereo device may represent a minimal, e.g. simple and/orlightweight, stereo head mounted display. The support device 2663 mayrepresent a “utility box” adapted to support functions not immediatelynecessary within the head mounted display proper, e.g. processingcapability, data storage, power, heat dissipation, etc. Such anarrangement may for example facilitate wearer comfort, convenience,unobtrusiveness (e.g. a compact head mounted display that may be lesslikely to be noticed by and/or cause offense in other nearby persons,etc.), and so forth. However, this is an example only, and otherarrangements may be suitable.

In the arrangement of FIG. 26, the mono controller 2668 and stereocontroller 2670 include therein data entities 2668-A through 2668-I and2670-A through 2670-I respectively. In particular, the mono controller2668 includes a graphical content communicator 2668-A, a mono displaydetector 2468-B, a mono perspective establisher 2668-C, a mono surfacebuffer establisher 2668-D, a mono image buffer establisher 2668-E, amono surface renderer 2668-F, a mono surface compositor 2668-G, a monoimage merger 2668-H, and a mono outputter 2668-I. The stereo controller2670 includes a mono controller communicator 2670-A, stereo displaydetector 2670-B, perspective invoker 2670-C, surface buffer invoker2670-D, image buffer invoker 2670-E, surface renderer invoker 2670-F,surface compositor invoker 2670-F, image merger invoker 2670-G, andstereo outputter 2670-H. With regard to the term “invoker”, as notedpreviously certain functions may be accomplished by either the stereocontroller 2670 performing such functions directly, the stereocontroller 2670 calling some other entity (such as the mono controller2668) to perform such functions, and/or some combination thereof; to“invoke” such functions may be considered a general term, including (butnot limited to) carrying out the functions directly and calling thosefunctions to be carried out.

Otherwise similar data entities to 2668-A through 2668-I and 2670-Athrough 2670-I were described with regard to FIG. 23, although as notedembodiments are not necessarily limited only thereto.

Now with reference to FIG. 27, therein is shown a another exampleembodiment of an apparatus 2760 for stereo and/or mixed mono/stereooutput, in schematic form. The apparatus 2760 as shown is integral, witha processor 2766 having a mono controller 2768 and stereo controller2770 disposed thereon, and with left and right stereo displays 2764-Land 2764-R, a data store 2772, a communicator 2774, and left and rightsensors 2776-L in communication with the processor 2766.

Such an arrangement as shown in FIG. 27 may for example include anintegrated stereo head mounted display adapted for stereo and/or mixedmono/stereo display, wherein most/all functional components thereof areincorporated into a portion wearable on a user's head. As a moreconcrete example, FIG. 27 may represent a head mounted display in theform a pair of glasses or the like, self-contained without externalpower supply, processor, heat dissipation, etc. However, otherarrangements may be equally suitable.

As shown in FIG. 27, the mono controller 2768 includes a graphicalcontent communicator 2768-A, a mono display detector 2468-B, a monoperspective establisher 2768-C, a mono surface buffer establisher2768-D, a mono image buffer establisher 2768-E, a mono surface renderer2768-F, a mono surface compositor 2768-G, a mono image merger 2768-H,and a mono outputter 2768-I. The stereo controller 2770 includes a monocontroller communicator 2770-A, stereo display detector 2770-B,perspective caller 2770-C, surface buffer caller 2770-D, image buffercaller 2770-E, surface renderer caller 2770-F, surface compositor caller2770-F, image merger caller 2770-G, and stereo outputter 2770-H. Similardata entities were described with regard to FIG. 23, although as notedembodiments are not necessarily limited only thereto.

As may be seen from FIG. 23 through FIG. 27 collectively, the formand/or arrangement of various embodiments may vary considerably, withvarious elements moved, added, removed, reconfigured, combined,subdivided, etc. The arrangements in FIG. 23 through FIG. 27 areexamples only, and embodiments are not limited thereto.

Now with reference to FIG. 28, therein is shown an example embodiment ofan apparatus 2860 for stereo and/or mixed mono/stereo output, inperspective view. As may be seen, in terms of overall configuration theapparatus 2860 in FIG. 28 may in some ways resemble the arrangementshown in schematic form in FIG. 27. That is, the arrangement in FIG. 28shows a head mounted display in the form a pair of glasses or the like,without external power supply, processor, heat dissipation, etc. beingillustrated. However, other arrangements may be equally suitable,including but not limited to arrangements as described with regard toFIG. 23 through FIG. 26.

As may be seen in FIG. 28, the apparatus 2860 therein includes aprocessor 2866, a data store 2872, a communicator 2874, left and rightstereo displays 2864-L and 2864-R, and left and right sensors 2876-L and2876-R. In addition, the apparatus 2860 includes a body 2878 in the formof a pair of glasses, with the processor 2866, data store 2872,communicator 2874, left and right stereo displays 2864-L and 2864-R, andleft and right sensors 2876-L and 2876-R disposed thereon.

In the example illustrated, the left and right stereo displays 2864-Land 2864-R are disposed on the body 2878 such that when the body 2878 isworn the left and right stereo displays 2864-L and 2864-R would bearranged in front of, facing, and proximate the eyes of a wearer, forexample so as to display stereo visual information to that wearer.Similarly, the left and right sensors 2876-L and 2876-R are showndisposed on the body 2878 such that when the body 2878 is worn the leftand right sensors 2876-L and 2876-R would be arranged in left and rightpositions proximate and facing substantially outward from the wearer'seyes, for example so as to capture stereo visual information at leastsubstantially comparable to that received by the wearer's eyes. However,the arrangement shown in FIG. 28 is an example only. Substantially anyconfiguration supporting the functions as described herein may besuitable, and may be utilized for various embodiments.

FIG. 29 is a block diagram of an apparatus that may perform variousoperations, and store various information generated and/or used by suchoperations, according to an embodiment of the disclosed technique. Theapparatus may represent any computer or processing system describedherein. The processing system 2990 is a hardware device on which any ofthe other entities, components, or services depicted in the examples ofFIG. 1 through FIG. 28 (and any other components described in thisspecification) may be implemented. The processing system 2990 includesone or more processors 2991 and memory 2992 coupled to an interconnect2993. The interconnect 2993 is shown in FIG. 29 as an abstraction thatrepresents any one or more separate physical buses, point to pointconnections, or both connected by appropriate bridges, adapters, orcontrollers. The interconnect 2993, therefore, may include, for example,a system bus, a Peripheral Component Interconnect (PCI) bus orPCI-Express bus, a HyperTransport or industry standard architecture(ISA) bus, a small computer system interface (SCSI) bus, a universalserial bus (USB), IIC (I2C) bus, or an Institute of Electrical andElectronics Engineers (IEEE) standard 1394 bus, also called “Firewire”.

The processor(s) 2991 is/are the central processing unit of theprocessing system 2990 and, thus, control the overall operation of theprocessing system 2990. In certain embodiments, the processor(s) 2991accomplish this by executing software or firmware stored in memory 2992.The processor(s) 2991 may be, or may include, one or more programmablegeneral-purpose or special-purpose microprocessors, digital signalprocessors (DSPs), programmable controllers, application specificintegrated circuits (ASICs), programmable logic devices (PLDs), trustedplatform modules (TPMs), or the like, or a combination of such devices.

The memory 2992 is or includes the main memory of the processing system2990. The memory 2992 represents any form of random access memory (RAM),read-only memory (ROM), flash memory, or the like, or a combination ofsuch devices. In use, the memory 2992 may contain a code. In oneembodiment, the code includes a general programming module configured torecognize the general-purpose program received via the computer businterface, and prepare the general-purpose program for execution at theprocessor. In another embodiment, the general programming module may beimplemented using hardware circuitry such as ASICs, PLDs, orfield-programmable gate arrays (FPGAs).

The network adapter 2994, a storage device(s) 2995, and I/O device(s)2996, are also connected to the processor(s) 2991 through theinterconnect 2993 The network adapter 2994 provides the processingsystem 2990 with the ability to communicate with remote devices over anetwork and may be, for example, an Ethernet adapter or Fibre Channeladapter. The network adapter 2994 may also provide the processing system2990 with the ability to communicate with other computers within thecluster. In some embodiments, the processing system 2990 may use morethan one network adapter to deal with the communications within andoutside of the cluster separately.

The I/O device(s) 2996 can include, for example, a keyboard, a mouse orother pointing device, disk drives, printers, a scanner, and other inputand/or output devices, including a display device. The I/O device(s)2996 also may include, for example, cameras and/or other imagers adaptedto accept visual input including but not limited to postures and/orgestures. The display device may include, for example, a cathode raytube (CRT), liquid crystal display (LCD), or some other applicable knownor convenient display device. The display device may take various forms,including but not limited to stereo displays suited for use in near-eyeapplications such as head mounted displays or other wearable devices.

The code stored in memory 2992 may be implemented as software and/orfirmware to program the processor(s) 2991 to carry out actions describedherein. In certain embodiments, such software or firmware may beinitially provided to the processing system 2990 by downloading from aremote system through the processing system 2990 (e.g., via networkadapter 2994).

The techniques herein may be implemented by, for example, programmablecircuitry (e.g. one or more microprocessors) programmed with softwareand/or firmware, or entirely in special-purpose hardwired(non-programmable) circuitry, or in a combination of such forms.Special-purpose hardwired circuitry may be in the form of, for example,one or more AISCs, PLDs, FPGAs, etc.

Software or firmware for use in implementing the techniques introducedhere may be stored on a machine-readable storage medium and may beexecuted by one or more general-purpose or special-purpose programmablemicroprocessors. A “machine-readable storage medium”, as the term isused herein, includes any mechanism that can store information in a formaccessible by a machine.

A machine can also be a server computer, a client computer, a personalcomputer (PC), a tablet PC, a laptop computer, a set-top box (STB), apersonal digital assistant (PDA), a cellular telephone, an iPhone, aBlackberry, a processor, a telephone, a web appliance, a network router,switch, or bridge, or any machine capable of executing a set ofinstructions (sequential or otherwise) that specify actions to be takenby that machine.

A machine-accessible storage medium or a storage device(s) 2995includes, for example, recordable/non-recordable media (e.g., ROM; RAM;magnetic disk storage media; optical storage media; flash memorydevices; etc.), etc., or any combination thereof. The storage mediumtypically may be non-transitory or include a non-transitory device. Inthis context, a non-transitory storage medium may include a device thatis tangible, meaning that the device has a concrete physical form,although the device may change its physical state. Thus, for example,non-transitory refers to a device remaining tangible despite this changein state.

The term “logic”, as used herein, may include, for example, programmablecircuitry programmed with specific software and/or firmware,special-purpose hardwired circuitry, or a combination thereof.

Now with reference to FIG. 30, as noted previously in variousembodiments the left and right renders of mono content may be identical,such that the same views of the same mono content are displayed to leftand right eyes of a stereo display. However, as also noted, such anarrangement with identical left and right mono content is not required,and other arrangements may be suitable. One example arrangement of suchis shown in FIG. 30.

As may be seen in FIG. 30, left and right images 3048-L and 3048-R areshown therein. However, where in certain other examples left and rightimages included identical or nearly identical mono content therein, inthe left and right images 3048-L and 3048-R in FIG. 30 the mono content(e.g. the frame, menu bar, battery indicator, time indicator, crosshair)are visibly different. Notably, the left image 3048-L is missingapproximately one third of the full width of the various content, both2D and 3D, along the right edge of the left image 3048-L. Similarly, theright image 3048-R is missing approximately one third of the full widthof the various content along the left edge of the right image 3048-R.

Such an arrangement may be produced in a variety of manners, includingbut not limited to changing the fields of view of the various renders,changing the size of the surfaces, cropping the surface buffers,surfaces, image buffers, and/or merged images, etc. Regardless of howsuch an arrangement is achieved, the left and right images 3048-L and3048-R are different from one another, as may be seen. Likewise, certaincontent in the left and right images 3048-L and 3048-R is not identical.

Although the above discussion has noted differences in 2D content suchas the frame, etc., as may be seen the 3D content therein (the variousgeometric solids) also is different between left and right images 3048-Land 3048-R. This is in addition to differences already shown for 3Dcontent, e.g. left and right images 3048-L and 3048-R differing so as topresent an appearance of three dimensionality through stereo effects.Thus, both 2D and 3D content may differ between left and right images3048-L and 3048-R, whether to manifest an appearance of threedimensionality or otherwise.

Although the arrangement in FIG. 30 is an example only, and is notlimiting, such an arrangement may be useful in at least certainembodiments. For example, if the left and right images 3048-L and 3048-Ras shown were aligned with approximately a 50% overlap, then the stereoeffect thereof may be modulated across the width of the combined images3048-L and 3048-R. That is, the right portion of the left image 3048-Land the left portion of the right image 3048-R would show similarcontent to one another, though the 3D geometric solids therein wouldexhibit different perspectives; thus the portion wherein the left andright images 3048-L and 3048-R overlap would (if properly aligned)exhibit an appearance of three dimensionality due to stereo effects.However, the left portion of the left image 3048-L and the right portionof the right image 3048-R would each show unique content to left andright eyes of a viewer respectively, without a stereo overlap, and thusthe left and right portions of what the viewer sees will appear twodimensional.

Such an arrangement is illustrated in FIG. 31. Therein is shown acombined view 3182 as may result from left and right images when viewedby a viewer; the combined view 3182 is divided into left, center, andright regions 3182-L, 3182-C, and 3182-R as shown by vertical lines inFIG. 31 (though in practice such lines may or may not exist, and ifexisting may or may not be visible). The combined view 3182 representsthe field of view of a viewer, merging left and right images togetherthrough stereo effects; the source of what the viewer sees may be fromtwo images, but the images are fused by the viewer's eyes and/or braininto an appearance of a continuous view.

For example, a left image may include the left and center regions 3182-Land 3182-C of the combined view 3182, while a right image may includethe center and right regions 3182-C and 3182-R of the combined view3182. This may be at least somewhat analogous to the left and rightimages 3048-L and 3048-R as shown in FIG. 30. However, given thediffering perspectives of the geometric solids in the left and rightimages 3048-L and 3048-R in FIG. 30, if those left and right images3048-L and 3048-R were combined the center region thereof would exhibitan appearance of three dimensionality due to stereo effects. Forsimplicity (and in view of the limits of two dimensional illustration),three dimensionality is not shown for the center region 3182-C of FIG.31.

However, such potential for three dimensionality in the central region3182-C of the combined view 3182 may be noteworthy. Given such anarrangement, the left region 3182-L may be effectively mono, showingcontent in two dimensions. The right region 3182-R likewise may beeffectively mono, also showing content in two dimensions. However, thecenter region 3182-C, wherein left and right images overlap, may bestereo, showing 3D content in three dimensions. Thus, the geometricsolids would appear three dimensional in the center of the combined view3182, but would appear two dimensional toward the left and rightthereof.

Such an arrangement may not be readily detectable, or at least may notbe sufficiently notable as to be distracting, to a viewer. Humanperception of three dimensionality typically is better towards thecenter of the combined field of view than towards the left and rightedges. Thus, even if only the center region 3182-C of the combined view3182 is in fact exhibiting a stereo 3D effect, the viewer mayautomatically “fill in the blanks” and consider their entire field ofview to exhibit a similar stereo 3D effect. Such an approach may resultin reduced resource demands, e.g. fewer processor cycles dedicated togenerating overlapping images if the area of overlap is smaller. Otheradvantages also may follow therefrom.

However, such an approach is an example only, and embodiments are notlimited only thereto.

In addition, it is noted that changes to the field of view, cropping,etc. of content in/for left and right images for output to a stereodisplay does not necessarily imply similar alterations to content in/formono images for output to a mono display. That is, a mono display mayexhibit a full field of view of content (e.g. as visible in FIG. 31),even if the left and right images do not. For example, because a monodisplay typically cannot output two images that a viewer may merge inhis or her eyestbrain, cropping a mono image may simply result in lossof content; thus a mono image may be left uncropped, while left andright stereo images are cropped, with the effect that viewers of monoand stereo displays may see the same or similar extents of content, evenif the individual images are not of similar extent.

The above specification, examples, and data provide a completedescription of the manufacture and use of the composition of theinvention. Since many embodiments of the invention can be made withoutdeparting from the spirit and scope of the invention, the inventionresides in the claims hereinafter appended.

1. A method, comprising: instantiating a mono controller on a processor; instantiating a stereo controller on the processor, the stereo control being in communication with the mono controller; receiving a mono perspective via the mono controller; receiving a left stereo perspective and a right stereo perspective via the stereo controller; receiving a dimensionality status of a graphical content source via the mono controller; receiving, from the graphical content source via the mono controller: a first two-dimensional (2D) graphical content and a second 2D graphical content; a first three-dimensional (3D) graphical content and a second 3D graphical content; rendering, with the mono perspective, a first mono surface from the first 2D graphical content or the first 3D graphical content and a second mono surface from the second 2D graphical content or the second 3D graphical content; rendering, with the mono perspective, a first left surface from the first 2D graphical content; rendering, with the mono perspective, a first right surface from the first 2D graphical content; rendering, with the left stereo perspective, a second left surface from the first 3D graphical content; rendering, with the right stereo perspective, a second right surface from the first 3D graphical content; compositing the first mono surface and the second mono surface; compositing the first left surface and the second left surface; compositing the first right surface and the second right surface; merging the first mono surface and the second mono surface to a mono image; merging the first left surface and the second left surface to a left image, wherein the left image comprises the mono perspective and the left stereo perspective; merging the first right surface and the second right surface to a right image, wherein the right image comprises the mono perspective and the right stereo perspective; outputting the mono image to a mono display coupled to the processor; outputting the left image to a left stereo display coupled to the processor; and outputting the right image to a right stereo display coupled to the processor.
 2. The method of claim 1, further comprising displaying on the left stereo display and the right stereo display 2D content from a first content source with a 2D status in conjunction with displaying on the left stereo display and the right stereo display 3D content from a second content source with a 3D status.
 3. The method of claim 2, wherein the 2D content displayed by the left stereo display and the right stereo display corresponds with the 2D content displayed by the mono display.
 4. The method of claim 2, wherein the left stereo display and the right stereo display displaying at least a portion of the 3D content in a window and at least a portion of the 2D content outside the window.
 5. The method of claim 1, wherein the mono controller is responsive to mono controller input delivered thereto.
 6. The method of claim 5, wherein the mono controller input invokes changing content of the mono image.
 7. The method of claim 5, wherein the mono controller input invokes changing 3D content of the mono image.
 8. The method of claim 5, wherein the mono controller input comprises touch screen input.
 9. The method of claim 1, wherein the stereo controller is responsive to stereo controller input delivered thereto.
 10. The method of claim 9, wherein the stereo controller input invokes changing content of the mono image.
 11. The method of claim 9, wherein the stereo controller input invokes changing 3D content of the mono image.
 13. The method of claim 1, wherein rendering at least one of the first mono surface, the second mono surface, the first left surface, the second left surface, the first right surface, or the second right surface comprises at least one of the mono controller rendering, the stereo controller rendering, or a further data entity in communication with at least one of the mono controller and the stereo controller rendering.
 14. The method of claim 1, wherein compositing at least one of the first mono surface, the second mono surface, the first left surface, the second left surface, the first right surface, or the second right surface comprises at least one of the mono controller compositing, the stereo controller compositing, and a further data entity in communication with at least one of the mono controller and the stereo controller compositing.
 15. The method of claim 1, wherein merging at least one of the first mono surface, the second mono surface, the first left surface, the second left surface, the first right surface, or the second right surface comprises at least one of the mono controller merging, the stereo controller merging, and a further data entity in communication with at least one of the mono controller and the stereo controller merging.
 16. The method of claim 1, wherein: rendering the first mono surface, the second mono surface, the first left surface, the second left surface, the first right surface, or the second right surface comprises the stereo controller calling the mono controller to render; compositing the first mono surface, the second mono surface, the first left surface, the second left surface, the first right surface, or the second right surface comprises the stereo controller calling the mono controller to composite; and merging the first mono surface, the second mono surface, the first left surface, the second left surface, the first right surface, or the second right surface comprises the stereo controller calling the mono controller to merge.
 17. The method of claim 16, wherein the stereo controller calling the mono controller to composite comprises at least one of: the stereo controller defining a virtual display for compositing by the mono controller; the stereo controller calling a composite function within the mono controller; the stereo controller activating executable instructions for compositing in the mono controller; and the stereo controller copying and executing executable instructions for compositing from the mono controller.
 18. The method of claim 16, wherein the stereo controller calling the mono controller to merge comprises at least one of: the stereo controller defining a virtual display for merging by the mono controller; the stereo controller calling a merge function within the mono controller; the stereo controller activating executable instructions for merging in the mono controller; and the stereo controller copying and executing executable instructions for merging from the mono controller.
 19. The method of claim 1, wherein the processor is disposed in a mobile device.
 20. The method of claim 1, wherein the processor is disposed in at least one of a smart phone and a head mounted display. 